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His wisdom, compassion and good sense played a significant role in the success 
of this collaborative effort. We miss him sorely. 
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PREFACE 

This Is the second general technical report of the Consortium for 
Longitudinal Studies. The first report entitled "The Persistence of 
Preschool Effects" was published in October of- 1977. While the main 
findings are summarized in this volume, the reader wishing more technical 
information on the earlier findings should refer to that report. This 
volume includes additional data and further analyses of the 1976-77 follow- 
up study conducted by members of the Consortium. 
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Lasting Effects After Preschool 
19 77-78 Report 
Abstract 

I. Overviet^ 

The Consortium for Longitudinal Studies is a collaborative effort 
of twelve research groups conducting longitudinal studies on the 
outcomes of early education program^. This report summarizes the 
findings of current analyses of longitudinal studies of low income 
children who participated in experimental infant and preschool 
programs initiated in the 1960*s. 

II. Methods 

The central data bank contains information on approximately 
3,000 low-income children. These children participated in early 
intervention programs or served as controls. The common Information 
across projects includes various measures of the children's home 
backgrounds collected before enrollment in preschool, for most cases 
a pretest IQ score, and at least one IQ test test score collected 
Iminediately after the preschool experience. In addition, each 
investigator collected a variety of cognitive and behavioral measures 
which are not common across all projects. In 1976-77, members of the 
Consortium collaborated in a common follow-up data collection effort. 
These data include interviews with both children and their parents, 
WISC-R IQ test scores for the children, achievement test scores from 
the schools, and indicators of the children's standing in their 
schools (i.e., whether they had ever failed a grade or been assigned 



to special education classes). The children were aged 9 through 19 
years old at the 1976-77 follow-up. 

Methodological problems such as problems of sample selection and 
measurement are discussed. Very detailed attrition analyses are 
presented. The statistical techniques used to test hypotheses and 
pool results are detailed. For example, we never pooled all 
subjects together. Instead, each project was considered separately 
for each hyp'^thesis test. Then the £ values of each project 
were pooled in order to test the null hypothesis that there 

is no average effect of preschool across programs. 
III. Findings 

The detailed attrition analyses indicated that attrition was 
essentially random, introducing no noticeable biases into our other 
analyses. 

The data analyzed thus far show that early education programs 
for children had lasting effects in the following areas: 

1. Assignment to special education . Early education programs 
significantly reduced the number of children assigned to special 
cducatioti classes. This result was true after controlling for the 
effects of children's initial IQ scores, sex, ethnic background 
and family background. It held even after controlling for 
children's XQ scores at age 6. Furthermore, the benefit apparently 
extended to all the low- income participants, regardless of their 
Initif.l abilities or early home backgrounds. 
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2. R etention in grade (grade failure) . The combined evidence 
from eight projects able to collect this information indicates that 
early education significantly reduced the nunijer of children 
retained in grade. Again, the result was true when measures of 
early child characteristics and home background variables were 
controlled. Furthermore, all low-income children — regardless 

of sex, ethnic background, early IQ, and home background — 
benefitted in this way. 

3. Achievement test scores . The Consortium had the most 
information for children at the fourth grade level. The; combined 
evidence from projects able to collect this information indicates 
that early education significantly increased children's scores on 
fourth grade mathematics achievement tests with a suggestive trend 
toward increased scores on fourth grade reading tests. 

^- Intelligence test scores . Low- income children who attended 
preschools surpassed their controls on the Stanford-Binet IQ test 
for up to 3 years after the programs ended. Current Wechsler IQ 
scores show that the children maintained that superiority in the 
Gordon, Levenstein, and Palmer projects. There were no treatment/ 
control differences found in projects whose subjects were aged 13 
or older. Using WISC scores as outcomes, there was no evidence 
that preschool benefitted boys more than girls, or vice-versa; or 
that children whose nKjthers had different levels of education 
were helped differentially. 
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5. Non-cognitive measures . Children who attended preschool 
were more likely than control children to give achieveiae- t-type 
reasons for being proud of themselves. The family context also 
appears to have been affected. Specifically, toothers of children 
who attended preschool had higher vocational aspirations for their 
children than the children had for themselves. This discrepancy 
was not found in mothers of control children. 

6, Use of child welfare services . For the four projects with 
data available, a preliminary investigation found no significant 
treatment /control differences in families' use of Title IV child 
welfare services. 

In order to illuminate the means by which preschool exerts its 
impact, ten different characteristics of preschool programs were 
examined: age of entry, length of program (in years, months per 
year, and hours per year), degree of parental influence, location 
of program, professional vs. paraprofessional staff, preservice 
training of staff, language goals for children, and avaount of 
teaching structure. None of these variables emerged as more 
effective than the others when assignment to regular vs. special 
education classrooms was the criterion of effectiveness. Furthermore, 
no one type of program was more effective (using the sa.ne criterion) 
than another with certain kinds of children (i.e. children differing 
on initial IQ scores, sex, and family background measures). We 
concluded that these high-quality programs were apparently about 
equally effective in helping low-income children. 
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IV. Implications 

High quality early education programs are likely to benefit 
both low-income children and the larger society by: reducing the 
number of children in later costly special education programs in 
schools, helping children avoid grade failure, increasing children' 
math achievement scores at fourth grade and IQ scores at least up 
to age 13, and influencing aspects of children's and mothers' 
achieveaent orientation. 
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INTRODUCTION 

In the early 1960*s, a mood of exuberant optimism was in the 
air regarding society's ability to solve problems. Technological 
know-how had thrust American n^n into orbit less than 5 years after 
the launching of Sputnik I. President Kennedy had successfully 
appli^ Keynes' theories of economic growth to propel the nation 
out of recession* Thus, President Johnson's announcement of the 
War on Poverty in 1964 was met with hope and confidence that the 
know-how of social scientists — together with infusions of 
dollars — would substantially alleviate if not eliminate the causes of 
poverty. As part of that effort. Project Head Start was initiated in 
1965 as a compensatory educational program for low-income preschoolers and 
their families. Its aims included the stimulation of the children's 
social and cognitive development, the provision of health services, 
and the encouragement of parental involvement with their children 
and in the community. 

One year after the first man walked on the moon, the Westinghouse/ 
Ohio evaluation report of effectiveness of Head Start programs 
appeared (Cicirelli, et al . , 1969). Essentially, it concluded tha^ 
Head Start programs had only a few weak and fleeting effects.^ Shortly 
thereafter, coinciding with efforts by a new administration to 

^ While these findings have been extensively criticized by 
methodologists and others, many have overlooked the report's 
influence in defining the criteria of •^success'': an increase 
in cognitive development which is maintained long after children 
leave the program (Datta, 1976) . 
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dismantle many anti-poverty programs, Moynihan advised a national 
policy of "benign neglect" of poor Blacks; Jencks, et al . (1972) 
suggested that indices of school quality were unrelated to children's 
level of academic achievement; and Jensen (1969) argued that 
intelligence is primarily genetically determined. ^ 

Since that time, slowly, but perceptibly, the climate of 
opinion has begun to improve. While no longer exhibiting the 
unbridled optimism of the 1960 's, a number of social scientists 
have sounded cautious notes to the effect that early intervention 
programs may provide benefits which endure over time (Brown, 1978; 
Datta, n.d.; Mann, et al., 1976). The research reported by the 
Consortium on Developmental Continuity (1977) contributed 
significantly to this assessment. The Consortium^ consists of 
12 different investigators who independently conducted experimental 
preschool intervention programs in the early and niid-'1960 's. Two 
additional members provide coordination and data analysis. 

In 1975 the Consortium members agreed to pool their original 
data and to collect common follow-up data in 1976-77. The initial 
findings of the follow-up effort indicated that preschool intervention 
programs had significant long-term effects on school performance. 
Specifically, compared to children in control groups, low- income 
children who received early education were bettor able to meet the 



The name of the Consortium hns recently been changed to the 
Consortium for Longitudinal Studies. 
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minimi requirements of their schools, as shown in reduced rates 
o£ assignment to special education classes and reduced In-grade 
retention. In addition, the gains on IQ scores achieved by children 
in preschool programs were maintained for at least three years after 
leaving the program (Consortiums 1977) • 

This report describes further analyses and findings of the 
Consortium's 1976-77 follow-up data. Work over the past year has 
concentrated on three general areas: (a) re-analysis of questions 
treated in the earlier report (Consortium, 1977) in order to 
include raw data received after July, 1977; (b) a search for long-- 
term measurable effects of preschool intervention programs beyond 
those considered in the earlier report; and (c) a search for evidence 
of differential effectiveness of preschool intervention programs. 
In preview we may say that our earlier findings have been 
confirmed. In addition, there is evidence that preschool programs 
affected children's achievement test scores, children's achievement 
orientation, and parents* aspirations for their children's future 
vocations. Using rate of assignment to special education classes 
and grade failure as measures of effectiveness, there was no 
evidence that programs were differentially effective for children 
from different home backgrounds. 

In this report we describe in detail each of the analyses and 
their limitations so that technical readers can assess our methods 
and conclusions for themselves. In addition, readers are asked to 
keep a few caveats in mind as they read this report. 



1, While the curricula and delivery systems used in these 
experiments can be found in Head Start programs in many places and 
could easily be adopted by others, and while the children were 
typical of Head Start's populations, these were not typical Head 
Start programs. They were experimental programs. They varied in 
ages, frequency and duration of sessions* However, some were 
actually Head Start sponsored, and current Head Start quality 
standards are such that similar curricula are likely to be part of 
typical Head Start programs. 

2, These studies were not initially designed for later 
comparisons or pooling the data. This is a secondary analysis, 
and there are very real limits on the airount of inforxuation that 
was common across studies when the projects collected their initial 
baseline information. However, they are, with a few exceptions, all 
the existing studies that can be used for the investigation of long- 
term effects of early intervention. It would take another 15 years 
(and at least five million dollars) to create a similar sample. 

3, The resea-rch questions in this report were somewhat different 
for these secondary analyses than those originally posed by the 
individual investigators. For example, we sometimes found it 
necessary to define treatment and control groups somewhat differently 
from the ways that the original investigators structured their 
comparison groups and analyses. Such changes are documented 
wherever they were made. 



DESCRIPTION OF THE CONSTITUENT STUDIES 

Although the various intervention programs had been independently 
conceived and carried out, they share several important characteristics: 

1. All programs were initiated and for the most part completed 
prior to 1969. 

2« The original samples were reasonably large, with a minimum size 
of 92 and a median size of 209. 

3. Certain conditions of research design had been met. 

4. Subjects had been followed after leaving the programs. 

5. The intervention programs were explicit and standard so that 
the content of the children's experience could be specified. 

Demographic data collected by the investigators at the time of 

the children's entry into the intervention programs^ provide a 

rough picture of the characteristics of the populations from which 

the samples were drawn. The samples were similar in that the 

overwhelming majority of the subjects were Black (92%) and poor. 

Forty percent did not have a father living at home and 51% had three 

or moTB siblings. The children's mothers had completed a mean pf 

10.5 years of schooling. The mean household SES was 64.0 on the 

Holllngshei.d Two-Factor Index of Social Position, placing the 

2 

mean in the lowest social class. In 1976-77 during the follow-up 
data collection, subjects ranged in age from 9 to 19 years old. 

^ With the exception of Seller, who collected this data retrospectively. 

See the Consortium (1977) for a detailed comparison of samples 
across projects. 
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More specific data on the characteristics of the samples and 
the individual projects can be found in Tables 1 and 2.^ The 
following descriptions of the projects include details of the 
prograiBS offered to the children and the design of the research, 
including san^le selection and assigmunt procedures. We also 
incltide our categorization of the projects^ niade for the purposes 
of the analyses included in this report aS| either closely 
approximating an experimental design or a quasi-experiirental design. 



This program provided an experimental preschool for children 
who were between 3 1/2 and 4 1/2 years of age at entry. Four 
classes were established in four different public schools In 
North Philadelphia. Each class was staffed by an experienced 
head teacher and an assistant; the ^sistants were liberal arts 
graduates with no prior teaching e^q^erlence. 

Seller^ s nursery program could be classified as traditional 
in orientation. Its goals were diverse and included increasing 
the child* s self-esteem as well as perceptual, cognitive, and 
physical development. It was "child-centered in. .that. . .learning 
was shaped aroimd the child's needs and preferences" (Seller, 1974). 

^ Background characteristics, IQ scores, and preschool attendance 
are listed only for the eight projects included in the regression 
analyses of school outcomes, to be detailed later in this report. 



The Philadelphia Project; Dr. E. Kuno Seller 
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BMides thm nursery subjects there were two other groups of 
chiJUlren: children who entered regular kindergarten with no prior 
preschool experience, end those who entered first grade with 
neither preschool nor kindergarten experience* Seller *s own 
research and analyses are concerned with comparing the effects of 
three different ages at entry to schooling,^ 

A pool of applicants ^fas generated by sending letters to the 

parents of all students in four schocj < located in North 

Philadelphia, which is a predominately Black and very poor 

neighborhood. The nursery children were selected randomly from 

this pool of applicants. The kindergarten group; 

•••consisted of 53 5 year-olds who entered the same 
kindergarten (as the nursery children, but) without 
prior nursery experience. These children were 
selected from a larger group to approximate age, 
sex distribution, and ethnic background (of the 
nursery children) (Beller, 1974, p, 16). 

The first- grade- only group was similarly selected from the first 

grade classes of the children in the first two groups. 

Seller's first-grade-only group has been excluded from most 

analyses in this report in order to compare children who were more 



The research qu€ cion in this report, however, was somewhat 
different for these secondary analyses. The treatment group 
was coaposed of children who attended experimental early 
education programs. Individual investigators, including 
Seller, say have structured their con^arison groups and 
analyses differently. 
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siailar on background characteristics.^ For the section of this 
report labelled '♦Non-cognitive Outcomes," however, Seller's first- 
grade-only and kindergarten groups were combined to create a single 
control group. Because of the procedures used in creating the 
three groups. Seller's study has been classified as quasi- 
experimental for this report. 

Of Seller's original 112 subjects in groups one and two, 74 
(66.12) were included in the follcw-up 8an?)les. For analyses of 
non-cognitive outcomes, 96 (56.4%) of the 170 subjects in groups 
one, two, and three were administered Youth Interviews. The modal 
age of these subjects at follow-x^ was 18. For additional 
information, see Seller, E.K. , Impact of Early Education on 
Disadvantaged Children, in S. Ryan (Ed.), A Report on Longitudinal 
Evaluations of Preschool Programs. Volume I; Longitudinal 
Evaluations . Washington, D.C.: Office of Child Development, 
DHEW Publication No(OHD) 74-24, 1974, pp. 15-48. 



Seller did not collect demographic data at the time of entry, 
but gathered retrospective demographic information while 
interviewing the mother at the time of follow-up. The first- 
grade-only group was significantly lower on mother's level of 
education. Five other retrospective variables did not reveal 
significant differences among the three groups. 
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Institute for DeveXopmentsl Studies ; 
Drs, Cynthia aad Martin Deutsch 

The Institute for Develofxaental Studies, which was established 
in 1958, examine the effects of a curriculum developed especially 
by the Institute on several sasiple waves of children from low- income 
areas of New York City* The program focused on four general areas: 
language development, concept formation, perceptual an'', overall 
cognitive development, and the child's self-concept. Teaching 
methods and materials developed by the program were designed to 
help children master basic academic skills and become independent, 
confident learners. Childrmi began the program during the 
prekindergarten year and continued through third grade. 

Staff members actively recruited children for the program, 
obtaining names from a variety of community sourcp.s such ps schools, 
churches and neighbors. Approximately one-third of the children, 
chosen randomly from the total sample, were designated as controls. 
This group of children first encotintered formal schooling in the 
regular kindergarten classrooms of the New York City public 
school system.^ 

Although this project closely approximated an experimental 
design, it has been classified for this report as qxmsi-experimental 
because of problems of attrition. It was possible to retrieve only 

^ In order to provide additional controls, two other groups were 
formed, one at the begiiming of each of the next two successive 
years. These control groups and later cohorts of children 
attending preschool were not included in the analyses reported 
here. 
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18. IZ of tb« original 504 children in the first four waves of 
treataftnt/control children (Groups 1 and 2). 
Severe Attrition Probl«ns in the Peutsch Data 

Unf orttmately , ve have had to omit the Deutsch project from 
908t of the tables in this report because of the extent and nature 
of the attrition in that project. First, the attrition was vastly 
higher for the Deutsch project than for any other: the project 
with the aedian attrition rate (Palmer's) recovered 2.82 subjects 
for every subject lost, while the Deutsch project recovered only 
.221 subjects for every subject lost — less than 1/12 as many. 

Additionally, the Deutsch project recovered predominately 
the best treatment-groi^ children and the worst control-group 
children. For example, for the school record data, the following 
occurred. At the end of the intervention program, when the 
children were aged about 5, the treatment group had a mean 
Stanford-Binet IQ score of 99.2 while the control group had a 
mean IQ score of 91.5. So far as we know, this difference of 7.7 
points between mean IQ scores represented genuine (even if 
t&Bporary) effects of the preschool program. However, when the same 
age-5 IQ scores are examined only for the sample whose school records 
were later recovered by the Deutsch team, the recovered treatment- 
group children had a mean age 5 IQ of 103.7 while the recovered 
control-group children had a mean age 5 IQ of only 84.2. Thus, if 
ve had used only the recovered sample to look at mean IQ scores 
inaediately upon completion of the preschool program, we would 
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have observed a difference of 19.5 IQ points instead of the difference 
of 7.7 points which presumably represents real effects of preschool. 
Thus, using the recovered sanple to estamine more persistent effects 
would presumably have yielded biases of the same magnitude. This 
tendency to recover the best treatment-group subjects and the 
worst control-group subjects was statistically significant for the 
school record at the .001 level, by the interaction rest described 
in this report's section on attrition. When the saa» interaction 
test was applied to the data from other projects, no biases nearly 
this large or significant were uncovered. 

Several explanations might be given for these unfortunate 
biases. The Deutsch children were older than most others, and thus 
harder to find. Problesis in New York City are often \mlike those 
anywhere else in the nation. School systems were reorganized, 
school buildings torn down, records lost. Whatever the causes, it 
seemed most prudent to present the Deutsch analyses separately. 
See Appendix D for these results. 

For additional information, see Deutsch, M., Taleporos, E., 
& Victor, J. A Brief Synopsis of an Initial Enrichment Program in 
Early Childhood. In S. Ryan (Ed.), A Report on Longitudinal 
Evaluations of Preschool Programs. Volume I? Longitudinal 
Evaluations . Washington, D.C.: Office of Child Development, DHEW 
Publication No (OHD) 74-24, 1974. pp. 49-60. 
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The Parant Education Program; Dr. Ira Gordon 
Dr. Gordon's project provided home-visitor, parent- focused 
intervention to children from 3 nonths to 3 years old in the 
Gaixieaville, Florida area. This study was specifically focused on 
the enhancement of the intellectual and personality development of 
the child and the production of changes in the mother's self-esteem 
and la her convictions that she could affect what happened to 
hereelf and her child. Gordon utilized trained paraprofessional 
home vlaitora who worked with each mother once a week. The 
sequenced curriculum emphasized Piagetian concepts appropriate 
to the child's stage of development. One treatment group 
received weekly visits for two years, starting when the child was 
3 months old; a second, visits from 3 months to 1 year of age; and 
a third, visits from 1 year to 2 years of age. For the third year 
of the study, when children were 2 years old, a new treatment, 
termed the Home Learning Center, was instituted. Children in 
groups of about five met in one family's home with their mothers 
and a paraprofessional teacher. 

Gordon's assignment procedures were complex. Three waves of 
children were involved, and the assignment procedures varied among 
waves. All three waves were randomly assigned to treatment or 
control groups, but the assignment in one wave was not on an 
individual basis. That is, entire towns, (or, in the case of 
Gainesville, sections of town) were randomly designated as treatment 
or control areas. At the start of the second and third years. 



^ Sometimes referred to as Backyard Centers. 
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cbildrsQ v«r« randoady re-assigned to treatment or no-treatment 
status. For example, for the Home Learning Center, a new group of 
2 year olds was recruited and earlier participants were randomly 
assigned cdtber to attend the small group experience or not. Thus, 
the experimental children received treatment for 1, 2 or 3 years and 
the control group received no treatment for the 3 year period. 
Because assignment was random, Gordon's project has been classified 
as e^qjerioental. 

Of the original 309 subjects, 107 (34.6Z) were included in the 
follow-up, Gordon's subjects were 10 and 11 years old at the time 
of follow-up. 

For further information about this project, see I.J. Gordon, The 
Florida parent education early intervention projects; A longitudina l 
look. Gainesville, Florida! Institute for Development of Human 
Resources, University of Florida, 1973. (ERIC Document Reproduction 
Service No. EDIOO 492.) (See also, Gordon, Guinagh, & Jester, 1977.) 

The Early Training Project; Dr. Susan Gray 
The Early Training Project, which was conducted in Murfreesboro, 
Tennessee, included both center-based and home-based components. 
It was explicitly concerned with fostering the children's 
intellectual growth and with their "attitudes related to school 
success" (Gray, 1974) and their general competence. In the summer 
programs, each group of about 20 children was served by one teacher 
and four assistant teachers? they typically worked in groups of 
five children with one adult. Traditional nursery school materials 
v«r« taqiloy^, but their use was non-traditional in that activities 
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were sequenced to becotae increasingly complex and were carefully 
focused on the goals of the program, e.g., increasing language use. 
The hoBe visitor served as an active liaison between home and school 
during the suaaer periods. During the 9 month hiatus between suoaaer 
prograos, hooe visitors worked with each family once a week for a 
period of 1 hour in order to prevent erosion of gains made over the 
suaaer. 

Sixty-five subjects were randomly assigned to one of two 
treatment groups or to one control group. The first treatment 
group participated in three summer (center-based) programs 
starting at age 4, with home visits spanning the 9 month intervals 
between suamier programs. The program for the second treatment 
group was identical to that of the first, except that they 
entered the program in the second summer at age 5. In the analyses 
reported here, these two groups are merged into a single treatment 
group. 

This report utilizes follow-up data on 55 of Gray's 65 subjecti 
(83.6% of the original sample). This excludes data on a distal 
control group. ^ The modal age of the subjects at follow-up w 19. 

For additional information, see Gray, S.W. Children From 
Three to Ten: The Early Training Project. In S. Ryan (Ed.), 



Gray recruited a second, self-selected comparison group in a nearby 
conaaunity, referred to as the "distal controls". The purpose of 
this group was to serve as a check against "horizontal diffusion" 
of treatment effects to non-treatment children in the same small 
coawmity. The analyses reported "here exclude this second 
coopariaon group in order to avoid weakening her strong experimental 
design. Additionally, distal controls were responsible for some 
differential attrition in this project. 

3i 
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A Report on Longitudinal Evaluations of Preschool Programs. Volume I 
Longitudinal Evaluations . Washington, D.C.: Office of Child 
DeveloiMunt, DHEW Publication No. (OHD)7A-24. 197A, pp. 61-68. Also 
Gray and Klaus, 1970. 

Curricul mn Coaparisqn Study: Dr. Mer l e Karnes 
In this study, two waves of children attended programs offering 
different curriculun n»dels: Bereiter-Engeltaann; Traditional; 
CoBdsunity- Integrated; ffontessori; and GOAL. Dr. Karnes' concept 
development curriculum. Each group attended one of the preschool 
nodels for about 2 hours a day for 7 to 8 months. The subjects 
were 4 year old children from families in the Champaign-Urbana, 
Illinois area vho were classified as socio-economically deprived 
using Read Start guidelines. 

The first wave was assigned to either a GOAL* Bereiter- 
Engelmann, or Traditional classroom; the second wave was assigned 
to either Bereiter-Engelmann, Montessori, or Coraaunity Integrated. 
There were no untreated controls. Classroom groups were 
stratified by IQ to insure a balanced range of intelligence scores 
in each class unit and to provide an opportunity to evaluate the 
effectiveness of the various programs on children from different 
ability groups. Children fron higher IQ levels had to be actively 
recruited for the program. None of the children had IQ scores 
less than 70; the aaan IQ score across all children was 
^proxiaately 95. Class units were examined to assure comparability 
of sex and race. When necessary, substitutions were mads between 
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classea to a*intain approximate ratios of 67% Black and 33% white 
plus 50Z male, 50% female. Finally, each class unit was randomly 
assigned to a particular curriculum. Since Karnes did not select 
a comparison group, her data were not used in analyses of treatment/ 
control differences. 

Follow-up data are available on 88 of 102 original subjects 
(86.3%). At follow-up the subjects ranged from 11 to 16 years of age. 

For additional information, see Karnes, M.B., Zehrbach, R.R., 
& Teska, J. A. The Karnes' Preschool Program: Rationale. Curricula 
Offerings and Follow-up Data. In S. Ryan (Ed.), A Report on 
Lonyitudinal Evaluations of Preschool Programs . Volume I; 
Longitudinal Evaluations . Washington, D.C: Office of Child 
Development, DHEW Publication No. (OHD) 74-24. 1974, pp. 95-104. 
See also, Karnes, Zehrbach and Teska, 1977. 

Verbal Interaction Project; Dr. Phyllis Levenstein 
The Verbal Interaction Project developed the Mother-Child Home 
Program, a home-based program for children aged 2 and 3 years and 
their -others in an urban area on Long Island, New York. Commercially 
available books and toys were taken as gifts to the homes on a 
weekly basis by "Toy Demonstrators," who demonstrated techniques 
\fhich were designed to encourage verbal interaction between the 
mothers and their infants. The toys and books were increasingly 
complex and were chosen to provide a structured cognitive 
curriculum. The program of 92 home sessions over two local school 
years was explicitly addressed to the mother and child as a socially 
intaractive dyad. The overall aim of the program was to support 

40 
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the mother (and through her, the family) in fostering the intellectual 
and Bocioeawtional development of her child. Other family members 
were encouraged to join the home sessions whenever possible. 

Levenstein's selection and assignment procedures were quasi- 
experimental rather than esqperimental.''' A number of treatment and 
control groups were created in three separate cohorts. Treatment 
groups varied in the amount of time they received home visits: 1 year, 
18 months, or 2 years. In addition, an "after-only" control group 
was recruited in the first grade. ^ Follow-up data are available on 
188 of 250 original subjects (85.22); at follow-up, the subjects 
ranged from 9 to 13 years old. 

For additional information, see Levenstein, P., The mother- 
child home program. In M.C. Day & R.C. Parker (Eds.), The preschool 
in action; Explori ng early childhood programs (2nd edition). Boston: 
Allyn & Bacon, 1977. (See also. Madden, Levenstein, & Levenstein, 1976.) 

Experimental Variation of Head Start 
Curricula; Dr. Louise Miller 
Miller's study contrasted four types of Head Start curricula: 
traditional, Bereiter-Engelmann, Montessori, and DARCEE.^ The 



Interestingly, 852 of mothers accepted vhen they were offered 
cither treattMnt or control status. 

2 

This control group was used only in the section entitled "Attitudes 
and Values." 

3 

DARCEE stands for Demonstration ^nd Research Center for Early 
Education. It was developed at George Peabody College in 
Kashville, Tennessee. 
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DARCEE subsample was further subdivided, with half receiving home 
visits and half not receiving home visits. Four target areas in 
Louisville were designated as appropriate sites '^r the program. 
Initially, each area was to receive all four programs, but a 
shortage of trained Montess '-ichers resulted in only two 
instead of four Montessori classes. All other program types were 
carried out in each area. 

A total of 214 4-year-olds were assigned to the experimental 
classes. Random assignment to classes was not used, as it would 
have entailed transporting children out of their neighborhoods. 
Rather, children were randomly assigned to programs within schools. 

The selection of a comparison group proved problematic. An 
initial control group of 34 children from the same neighborhood — 
including 21 children from the Head Start waiting list ~ were 
selected at the outset of the program. However, this control group 
had a significantly higher percentage of whites and a significantly 
greater percentage of father-present homes than the treatment group 
at the outset; in addition, the control subjects had substantially 
higher mean incomes. This introduces an appreciable conservative 
bias into the calculation of treatment effects. 



After the preschool year, some subjects from each group enrolled in 
Follow-Through kindergarten, while the remainder went into regular 
kindergarten. In addition, some of the Bereiter-Engelmann subjects 
went into a special Bereiter-Engelmann kindergarten. However, with 
one exception, none of the control children went into either Follow- 
Through or Bereiter-Engelmann kindergarten. Additional low- income 
children were recruited who had not been in preschool but who were in 
either the Follow-Through or the Bereiter-Engelmann kindergarten. 
These control children were excised from most analyses with the 
exception of those in the "Non-cognitive Outcomes" section of the report. 
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Because children were not randomly assigned to control ' groups 
and control groups later proved to be significantly different from 
treatment groups on some background variables, Miller's project has 
been classified as quasi-experimental. 

Follow-up data are available for 127 of Miller's original 248 
subjects (51.2%). The modal age of the subjects at follow-up was 13. 

For additional information, see Miller, L. & Dyer, J.L. Four 
Preschool Programs: Their Dimensions and Effects. Monographs of the 
So ciety for Research in Child Development . 1975, 40 (5-6), Serial No. 162. 

Harlem Training Project; Dr. Francis Palmer 
This program tested two models: a structured, concept training 
program^ and a less structured "discovery" program. The Concept 
Training curriculum wae designed to teach simple concepts believed 
to be prerequisite to subsequent learning. These concepts were 
introduced in order of increasing difficulty. The "discovery" 
program had no formal curriculum but children were otherwise treated 
identically to the concept training group (Palmer & Anderson, 1978).^ 
Three durations of programs were tried: 123 children entered at age 
2, 121 at age 3, with a subset of 20 children trained at both 
age 2 and 3. In all groups, children were brought to a center over 
a period of 8 months for twice-weekly sessions which lasted 45 
minutes. Tutors worked one-to-one with each child. 



This curriculum, termd One- to-One , has subsequently been revised 
for home as well as center use. 

The children played with the same toys that were used to teach 
concepts, but tutors neither initiated conversations nor "taught" 
Che child. 
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Treatment and control children were recruited from the birth 
records of the same two hospitals. The research design called for 
Black, male children from lower class and middle class families with 
certain birth criteria.^ Children born in the months of August to 
October, 1964, were randomly assigned to a treatment group. Children 
born in November and December, 1964, were recruited specifically as 
controls. However, this selection procedure may not have introduced 
serious bias since the project staff emphasized the benefits of a 
total of 4 1/2 weeks of testing in recruiting the controls. One 
could thus see the control parents as volunteering for a less 
extensive program. Consequently, Palmer's study has been classified 
as experimental for the purposes of this report. 

Follow-up data are avaiable for 228 (73.8%) of Palmer's initial 
309 subjects. The modal age of the subjects at follow-up was 13. 

For additional information, see Palmer, F.H. and Siegel, R.J., 
1977. See also. Palmer and Semlear, 1976 and Palmer, Semlear and 
Fisher, 1978. 

The Perry Preschool Project; Dr. David Weikart 
The Perry program was a preschool program in Ypsilanti, 
Michigan. The children involved had all tested in the 50 - 85 range 
on an IQ test; their families had been rated as disadvantaged on an 
index which included educational and occupational levels and 
household density. Children entered at the age of 3 and attended 
half-day sessions 5 days a week for 2 school-years (October through 



Over 5 pounds at birth with English-speaking mother who had no 
history of drug addiction or venereal disease. 

d4 
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May). Te*ch«r« also made 90 minute weekly home visits. The 
curriculum vm mainly Plagetian, focusing on cognitive objectives. 
Heavy emphasis was placed on experiences that would stimulate the 
child to construct concepts and develop logical modes of thought 
(Weikart, Deloria & Lavser, 1974). 

Assignment to treatment and control groups was essentially 
random. The only noteworthy exception to this generalization is 
that in cases where a child assigned to the treatment group could 
not attend due to lack of transportation or maternal employment 
(preventing scheduling of home visits), the child was exchanged 
with a matched child assigned to the control group. Unfortunately, 
this produced a group difference on maternal employment:^ 8.6% of 
the QKJthers in the experimental group vs. 30.8% of the control 
mothers, were employed (p - .002, two-tailed). Nonetheless, this 
study has been classified as experimental as this one exception was 
deemed a relatively minor departure from a pure experimental design. 

Four cohorts were included in the study. At the time of 
follow-up, the subjects ranged from 15 t;o 19 years of age. Follow-up 
data are available on all of the 123 original subjects. 

For additional information, see Weikart, D.P., Deloria, D.J., & 
Lawser S. Results of a Preschool Intervenf.lon Project. In S. Ryan 
CEd.), A Report on Longitudinal Evaluations of Preschool Programs . 
Volume I; Longitudinal Evaluations . Washington, D.C.: Office of 



Stjbsequent analyses of maternal employment when children were aged 
15 and analyses of whether mothers had ever been employed found no 
significant differences between treatment and control children. 
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Child D«v«lopmnt, DBEW Publication No. (OHD) 74-24. 1974. pp. 125-133. 
SM •1.0. Wtb«r. C.U.. rotter. P.W.. & Weiluirt. D.P. (1978); 
Witort. D.?.. Bond. J-T.. & McNeil. J.T. (1978); and Weikart. D.. 
Beloria, D., & L«w»er, S. (1970). 

Micro-Social Learning System; Dr. Myron Woolaan^ 
Dr. WooXaaa atudied the effecta of a preachool program utilizing 
an «rranse»ant of modular units in which children worked through a 
pr«-pUnned tcriM of activities. They received periodic reinforcement 
aa thay completad each objective in a sequence. The program design 
alao included a life-simulator space in which the children applied 
th«ir newly learned skills in free play. This aspect of the program 
utilised materials and equipment designed to provide unstructured 
free response favoring interactive play. 

The program group, selected by the Vineland school district, 
consisted primarily of the children of migrant families, the 
majority of whom were on welfare. About 10% of the group were 
children of higher socioeconomic status whose parents had requested 
that they be allowed to enter the program. Since the program group 
consisted of the highest risk children in the school district, there 
did not exist a sufficiently large non-treated group which could be 
used as a control group. Therefore, it was decided to compare the 



^ Note: Since Dr. Wooiman's dataware complete as of July. 1977 
thi! group was not included in the October. 1977 - August. 1978 
InalvSw For a raport of the effectiveness of this program see 
SI Conlirtium. 1977. Briefly, the program significantly reduced 
s.u^ ..«^*«> i%¥ nUtlArmn r«t«lned in firade. 



thm ntab^r of chUdrtn retained in grade. 

4e 
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program children to the general school population. A random 
SA^le of the previous year's first grade population, including 
both middle and lower class children, was selected. 

Because the program group had a much higher percentage of 
Spanish-sumaaed children than the general school population, an 
additional 36 Spanish children were randomly selected from the 
prior year's first grade population. This group allowed the 
additional comparison of Spanish-sumamed program children to 
Spanish-sumamed children in the general school population and. 
in effect, constituted a control for ethnicity and social class. 

For additional information, see Wooloan, M. , Learning for 
Cognition ; The Mlcro-Social Learning System ^ Report to the New 
Jersey State Department of Education, 1971. 

New Haven Follow Through Study; Dr. Edwarrt Zlpler 
This study investigated the effects of Head Start and Follow- 
Through programs on two cohorts of children in New Haven, 
Connecticut. The original group has now been followed through the 
eighth grade. In the first wave the program groups consisted of 
children recruited for Follow-Through in several low- income areas. 
The control group consisted of ecocjmically disadvantaged children 
in one classroom from each of three sclwols located in similar 
low-income areas. For the second wave, the control group consisted 
of children drawn randomly from the same schools from which the 
original controls had been drawn. Since the program and control 
children were not drawn from a common pool of children whose parents 
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had volunteered them for Follow-Through, the extent of the self- 
selection bias in unknovm. It is likely to be minimized by the 
fact that the controls were drawn from different schools than the 
program children; that is, the controls did not consist of children 
whose parents had decided not to participate in the program. 
Therefore, this project has been classified as quasi-experimental. 

At follow-up, 185 of the original subjects were retrieved. 
The ncial subject was aged 13 years. 

For further information, see Seitz, V.. Apfel, N., & Efron, C. 
Long-term Effects of Early Intervention; The New Haven Project. 
In B. Brown (Ed.), Found: Long-t erm Gains from Early Intervention. 
Boulder. Colorado: Westview Press, 1978. (See also, Abelson, 
Zigler, & DeBlasi, 1974.) 
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Table 1 



Characteristics of Early Education Pro grams and As^es of Subjects for Each Data Set 



Early 

Principal Education 
Investigator Program 



Location 



Seller 



Population Type of Subject Age at Length of Age at 

(1970) Delivery ^irth Entry to Program Years of 1977 
OOP System Year Program (years) Program Follow-up 



The Philadel- Philadelphia, 
phia Project Pennsylvania 



1,949 Center 1959 4 years 1 year 1963-64 IB 



Deutsch 



Institute for New York, 
Developmental New York 
Studies 



7,895 Center 



1958- 4 years 5 years 1963-71 15-19 
1962 



Gordon 



Gray 



The Parent 

Education 

Program 



The Early 
Training 
Proj ect 



Gainesville, 
Florida 



Murf reesboro, 
Te&n«&s^e 



64 Home 



26 Home/ 

Center 



1966- 
1967 



1958 



3 mos, 3 years 
to 2 yrs. 



1966-70 10-11 



3.8 or 14 mos. 1962-65 
4.8 yrs. or 26 mos. 



19 



Karnes 



Curriculum 
Conq>arison 
Study 



Chanqjaign- 
Urbana , 
Illinois 



89 Center 



1961- 
1963 



4 years 1 year 



1965-66 14-16 
(2 waves) 



Leveostein 



The Mother- 
Child Home 
Program 



Glen Cove, 26 

Manhasset and 8 

Freeport, Long 40 
Island, New York 



Home 



1964- 2 yrs. & 1-11/2 1967-72 9-13 
1968 3 yrs. years 



i9 



bO 



Table 1 (Cont.) 



Principal 
Investigator 



Early 

Education 

Program 



Location 



Population 
(1970) 
000 



Miller 



Experimental 
Variation of 
Head Start 
Curricula 



Louisville, 
Kentucky 



361 



Type of 

Delivery 

System 



Subject 

Birth 

Year 



Center & 

Center/ 

Home 



1964 



Age at 
Entry to 
Program 



Length of 

Program 

(years) 



Years of 
Program 



A years 1 year 



Age at 
1977 

Follow-up 



1968-69 13 



Palmer 



Weikart 



Harlem 

Training 

Project 



Perry Pre- 
school 
Project 



New York, 
New York 



Ypsilanti, 
Michigan 



7,895 



30 



Center 



196A 



Center/ 
Home 



1958^ 
1962 



2 or 3 
years 



3 yrs- 
(1st 
wave) 

4 yrs . 



1 or 2 
years 



2 yrs. 
(1st 
wave) 
1 year 



1966-68 13 



1962^67 15-19 
(5 waves) 



Wcolman 



Zic^ler 



Micro-Social Vineland , 
Learning New Jersey 

System 



New Haven 
Follow- 
Through Study 



New Haven, 
Connecticut 



47 Center 1963- 4-5 yrs. 1-4 yrs. 1969-73 9-14 

1968 



138 



Center 



1962 5 years 4 years 1967-71 15 



52 



5i 
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Table 2 



D*ta Sec (n)* 
Seller (56) 
Gordon (64) 
Gray (52) 
Karnes (61) 
Levenstein (125) 
Miller (120) 
Palaer (219) 
Weikart (123) 



. Background ca>aract eristics, IQ Scores, and Preschool Attendance for Each Data Se t 
Mean 
Mother's 
Educational 
Level 



Mean C820) 



Mean 

No. of 
Siblings 



Mean 
Pretest 
IQ 

Score 



Mean IQ 
Score 
at 

6 Yrs. 



Percent 
Father 
Present 



Percent 
Black 



(1.7)^ 

9.98 
(X.9) 

8.67 
(2.7) 

10.16 
(1.9) 

10.69 
(1.9) 

10.68 
(2.0) 

11.13 
(1.8) 

9.42 
(2.2) 



2.96 I, 
(2.4)^ 

2.59 
(1.9) 

4.17 
(2.3) 

3.46 
(2.7) 

2.50 
(1.6) 

3.24 
(2.1) 

2.41 
(2.1) 

3.89 
(2.6) 



92.89 
(55)*" 



97.25 
(53) 



75.0 



92.9 





92.50 


" ~ ^ 


92.2 




(62) 




89.25 


90.94 


67.3 


100.0- 


(48) 


(50) 






95.84 


104.75 


62.3 


62.3 


(61) 


(56) 


84.52 


97.67 


70.4 


94.4 


(121) 


(118) 








94.42 


45.0 


91.97 




(120) 




92.12 


95.54 


72.6 


100.0 


(132) 


(195) 




79.02 


88.63 


52.9 


100.0 


(123) 


(120) 







Percent 
Male 



50.0 
43.8 
50.0 
50.0 
56.8 
46.7 
100.0 
58.5 



10.21 



3.15 



89.82 



94.86 



63.6 



91 .7 



50.8 



Percent 
Preschool 
Participants 
(vs. control) 



58.9 



89.1 
65.4 
100.0 
81.6 
85.0 
78.5 
47.2 



72.2 



Kote. 



ira'^rLilLMf fo^^^^^r' ^TS??/'"^ Levenstein). Palmer IQ scores are at age 5 instead of 6. Data 
ara not available for Gordon and Miller pretest IQ score, and Gordon father presence. 

b li^V" J° P««»^I;"«» indicate number of children in all calculations except IQ scores. 

di5u"o^.^''^ Bother's educational level and mean number of siblings are standard 

^ Figures in parentheses indicate number of children in IQ score calculations, 
a Mean IQ scores exclude Levenstein PPVT scores. 
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METHODS 

The research reported here and in previous publications 
represents the results of secondary analysis of samples of children 
who have been followed for a number of years. This section of the 
report will discuss some of the issues and problems which arise in 
the course of such analysis and will outline the nature of the 
solutions used by the central staff. 

General Problems in 
T^nj^itudinal Assessments of Progra m Effects 
Longitudinal data, such as that collected by Consortium 
members, provide a valid and direct way of assessing the 
cognitive, social, emotional and familial outcomes of programs 
for young children. The Consortium studies are further 
strengthened by the use of control or comparison groups. An 
alternate strategy — using children as their own controls -- 
inextricably confounds program effects with maturational changes 
which would occur regardless of experience in programs. However, 
these strengths are accompanied by attendant weaknesses: issues of 
equivalence of treatment and control groups and problems of 
attrition and measurement. 

The dangers of non-random assignment to treatment and control 
groups and the general inadequacy of standard statistical 
techniques that "correct for" sampling biases have been well- 
documented in evaluation literature (e.g., Campbell & Erlebacher, 
1970). If random assignment is not used, there is no way to know 
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whether the treatment and control groups were initially comparable in 
all respects^ and, hence, no way to accurately assess whether the 
treatment had any effect. Doubts can be raised even when numerous 
indicators of initial status (e.g., IQ, SES) were collected at the 
outset since it can always be hypothesized chat the "true difference" 
between the treatiKnt and control groups was not reflected in these 
measures. Self selection of either subjects or controls is also 
reason for concern. When subjects are self-selected, their later 
outcomes may reflect characteristics which led them to volunteer 
(to be either subjects or controls) rather than characteristics 
of the treatment. 

In general, randomization is difficult to attain in evaluation 
research for both practical and ethical reasons. However, some 
projects in the Consortium more nearly approximate experimental 
designs than others. For purposes of data analysis, we have 
designated certain projects as experimental and others as quasi- 
experimental based on their sample selection and assignment 
procedures.^ This procedure is intended as a safeguard to help 
insure that the findings are not artifacts of limitations in 
individual studies. Our categorization, however, is open to 
question a^^ other reviewers might reach different decisions. 

^ Those designations were as follows. Experimental: Gordon, Gray, 
Palmer, Weikart. Quasi-experimental: Seller, Deutsch, Levenstein, 
Miller, Woolman, Zigler. 
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The Problem of Attrition 
When one of our co-directors (Darlington) joined this project, 
he was, like many people, extremely suspicious of the problem of 
attrition in the Consortium data. We have subsequently analyzed the 
problem of attrition in an unusually thorough manner, performing 
hundreds of significance tests, any one of which might indicate some 
problem involving attrition. These tests concern the following four 
questions: (a) What is the overall rate of subject loss? (b) Are 
the subjects who have been lost different in important ways from 
those who have been retrieved? (c) Is the rate of subject loss 
different for treatment and control groups? (d) Do the 
characteristics of the lost subjects differ as a function of group 
membership (for example, did the study lose the brii,htest controls 
and the low-IQ treatment subjects)? These analyses did reveal some 
rather severe problems concerning attrition in the Deutsch data. 
As a result, the Deutsch data have been omitted from all our major 
analyses. These problems are described more fully in the section 
on project descriptions. In data from the remaining projects, 
our analysis supported the view that the final samples are 
representative of the original sample and the final sample treatment 
and control groups appear to be equivalent. The complete attrition 
analysis is presented in Appendix A. 

Problems of Measurement 

Longitudinal research also poses problems of measurement, one 
of which is particularly relevant to the present report: the 
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potential non-equivalence of identical measures administered at 
different ages. The data on which the present report is based are 
derived from essentially identical tests and interviews administered 
to subjects ranging in age from 9 to 19. Since treatment subjects 
were compared to control subjects of similar ages, there is no 
reason to expect that age-related non-equivalence of the instruments 
would produce artif actual treatment-control differences. Indeed, 
such non-equivalence would be expected to attenuate true treatment 
effects by contributing additional random variation within the 
treatment and control samples. However, it could be a serious 
problem in several other types of analysis, such as age main 
effects, age (at measurement) by treatment Interactions, and 
contrasts between programs (as the programs differ in age at 
follow-up) . 

An additional problem of longitudinal research is what 
Campbell (1971) and others have called "temporal erosion". While a 
developmentalist might quarrel with the simplicity of Campbell's 
stateaent that "all relationships weaken with time", it would 
certainly be expected that many, if not most, treatment-control 
differences would erode with time. In the present report, the 
lag between the end of the subjects' intervention experience and 

the time of follow-up data collection is as much as 14 years 

time enough for even very gradual erosion to take a heavy toll., 
On the other hand, it is possible that intervention programs not 
only taught concrete skills, but altered th*> context in which the 

^8 
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children operated. For example, the mother-child interactive system 
may have been affected by intervention and this "new" interactive 
system could operate in such a way that erosion would be lessened. 
More concretely, suppose a given program had an effect on cognitive 
abilities and on school performance which, v^ile strong, was 
relatively shortlived (2 years, let us say). The initial improvement 
in the child's school performance might affect the mothers* and the 
teachers' expectancies and their behavior towards the child. This 
could, in turn, affect the child's own attitudes and behavior. Thus, 
the simple original "treatment" could reverberate through time. 

Campbell (1971) recommends the use of repeated measurements in 
order to assess temporal erosion and to gauge treatment effects 
realistically. Lacking that opportunity in the present case, we 
can only be alerted to the issue and keep in mind that the data 
presented here test only the null hypothesis of no persistent 
effects. A failure to disconfinn the null hypothesis could be 
entirely due to the non-persistence of effects rather than an 
initial absence of effects. 

Issues Inherent in Multi-sample Secondary Analysis 
The data presented here include a number of different programs 

(and samples) and hence, in most cases, can be seen as a set of 

replications of each hypothesis test. A number of issues arise in 

choosing how to deal with data of this sort. 

The first choice involves the unit of analysis: should 

analyses consider each subject in each program as an individual 
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case? There are some instances (e.g., the analysis of differential 
effectiveness of specific preschool programs; see Koretz, Vopava 
and Darlington, 1978) where the only valid option is to use 
programs as the unit. In others, the child is naturally the unit 
of analysis; that is, when the independent variables under study are 
properties of the child such as family background, IQ scores, etc. 

When using subjects as a unit, the simplest approach would 
be to pool all subjects into a single large sample prior to 
analysis. This approach, however, is unacceptable because 
differences between san^les can yield artifactual results.^ 
Instead, unless otherwise noted, we have pooled subjects within 
projects only. 

The next issue is how to pool results across samples. 
Unless othexrwiae noted, we have used a method whereby scores 
are summed. First, the exact £ value of results from each sample 
is converted to a and given a sign according to the direction of 
the effect. These z scores are then sximmed by the formula: 

2 m — — * 



As a simple example, consider an analysis which includes two 
totally ineffective programs. Let program A have a treatment group 
of size 100 and a control group of size 20. Let both groups have 
mean pre- and post-test IQ scores of 90. Program B has 20 treatments 
and 100 controls, with pre- and post-test means of 80. Analyses of 
each group separately would correctly show no treatment effect. If 
the two sastples were pooled, however, the resulting sample would 
show a post-test mean difference of 6.7 points. 
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where is the z. score from sample i and k is the number of samples 

(Hosteller & Bush, 1954) ^" This method is more powerful than an 

analogous chi-square technique (c.f. Mosteller & Bush, op. cit.) 

for cases in which results tend to be consistently small but arc 

in the same direction. Additionally, it is directional, and 

contrary results in different samples will be excelled out. 

Thus, this formula can be seen as testing the presence of an 

2 

overall * average' effect. 

While the method above tests the magnitude of an average, 
overall effect, one might also want to test the consistency of a 
result across programs. To do so, programs are treated as the 
unit of analysis. 

Analyses based on programs as the unit of analysis involve far 
smaller sample sizes than those based on subjects, and many people 
would assume that the decrease in sample size brings with it a 
commensurate decrease in power. However, as Darlington (1978a) 
points out, this is not necessarily the case, due primarily to the 
greater stability of group means as compared to individiial scores. 



See also, Darlington, 1975. 

One null hypothesis with regard to preschool effects on later 
outcomes might be that no program had any effect. In this case, 
finding even one program with significant effects would be enough 
to reject the null hypothesis. However, the null hypothesis we 
ctose to investigate is: averaged across many programs, preschool 
does not affect later outcomes. In this case, if three programs 
were to have a positive effect and three a negative effect, they 
would cancel each other out and, as a result, the null hypothesis 
could not be rejected. 
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A study on a few dozen observations, each of which is very stable 
because most of the variation caused by single individuals has 
been averaged out, can be nearly as powerful as one with 2,000 
observations. This effect is not just a theoretical one; we have 
observed a nuxaber of times in our data that significance levels 
computed with the smaller N are of comparable magnitude to those 
computed with the much larger N, Yet the smaller N is far more 
valid a procedure, because it handles the problem of nonindependent 
observations (e.g., the effects of an unusually skilled teacher 
across one classroom) , 

An additional concern in pooling results, closely related to 
the issue of the consistency of results across samples, is the 
robustness of the test. As we shall use the term here, "'robustness" 
refers to the ability of an overall significant result to withstand 
the removal of one or more samples. An overall significant result 
might be caused by exceptional results from one project or program. 
In field research like this, it is impossible to eliminate all the 
experimental inelegancies that can be eliminated in true laboratory 
research, and we have to assume that in a dozen projects, there must 
have been known or unknown design problems in at least one or two — 
and we don*t know which one or two. To take this possibility into 
accountf we rank-order the projects or programs in terms of the 
degree to which the results from f:he project or program confirm our 
experimental hypothesis. We then delete from the analysis, one by 
one, the projects or programs whose data most strongly confirm our 



36 



experimental hypothesis. If a significant result evaporates after 
just one such deletion, we do not consider the finding a strong one. 

Finally, the reader will note that analyses throughout this 
report are perfonned separately for varying numbers of subgroups 
and frequently utilize laany different dependent measures. Because 
of the large nuinber of teste, it would be possible to obtain 
"significant" results by chance alone. To correct for this 
possibility, we have, as a general policy, used the Bonferroni/ 
Ryan statistical technique to correct for multiple con^arisons. 
This technique involves multiplying the significance level of each 
result by the number of tests performed (c.f. Darlington, 1978b). 
This is a conservative procedure in that all significant results 
are not accepted at face value; but it maximizes our confidence 
in the results* 



p.? 

ERIC 



37 



COGNITIVE EFFECTS OF PRESCHOOL 



Intelligence Test Scores 



For reasons of availability and comparability, many intervention 
programs routinely administered IQ tests to prrticipating children. 
The Consortium projects had information on children's IQ measured 
before and soon after intervention. In addition, the 1976-77 follow- 
up included WISC-R IQ tests. As the Consortium (1977) reported, early 
education proved to have a significant effect on children's IQ scores 
(Stanford-Bi.xet) that lasted at least 3 years beyond the preschool 
experience. After analysis of the WISC-R IQ data, however, the 
investigators concluded that the effect of preschool intervention 
programs on children's IQ was not permanent, since projects with 
children older than 10 years showed no statistically significant 
treatment/control differences. 

Those initial findings have now been extended by: (a) evaluating 
the effects of preschool experience, independent of family background 
variables and initial IQ, on post treatment IQ scores at age 6;^ 
(b) performing analyses that include additional WISC-R data received 
since July, 1977; (c) investigating the effects of preschool on each 
of the Wise subtests; and (d) investigating the effects of preschool 
on the variability of WISC-R at later ages. 

The first question is very important since it is possible that 
the earlier report of preschool effectiveness at raising IQ scores 

^ See the list of Consortium members' reports and publications for 
other treatments of this question. 
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for 3 years was due primarily to factors other than the preschool 
experience. Questions (b) , (c), and (d) above are important in order 
to understand in more detail the long-term impact of preschool on IQ. 
Methods 

Although the various projects comprising the Consortium were 

initiated at different times and were designed for children of a 

range of ages, nearly all had administered individual Stanford- 

1 

Binet IQ tests to their subjects when they were 6 years old. 
In order to help insure that the IQ gains found earlier for 
children who attended preschool were not caused by initial 
(pretreatment) differences between the treatment and control group, 
multiple regression was used. This technique allows one to assess 
the independent effect of preschool attendance on IQ at age 6 
[question (a) above]. The independent variables in the regression 
were: child's sex, initial IQ score, family structure (father 
absent or present), family size (number of siblings) and mother's 
level of education. The unit of analysis was the individual child 
within a project. Analyses were performed for each project. The 
F value for the regression coefficient for preschool vs. 



The IQ data used differed for two projects. Palmer's IQ scores 
are for children at age 5. Levenstein's project had more data 
for the Peabody Picture Vocabulary Test than for the Stanford- 
Binet test. Accordingly, the pretest and posttest IQ scores for 
Levenstein are PPVT scores. 

The N for each project may differ somewhat from earlier reports 
or from figures cited in this report. For these analyses, only 
children with complete information for every independent variable 
were used. 
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control v&s converted to e £ score and £ scores were then pooled and 
tested for significance according to procedures described earlier. 

For the WISC-R analyses [questions (b) , (c) and (d) above], 
each project was considered separately. Data were not merged across 
projects and significance levels were not combined across projects. 
This procedure was follow^ because the WISC-*R tests were 
administered to subjects of different ages across projects and 
different lengths of time had elapsed since the preschool 
e3q>erience. In effect, this meant that the projects were not 
asking the same research question. Con^sarisons across projects 
for these questions, then, are only descriptive. 
Results 

Five data sets^ had sufficiently complete data to test the 
simultaneous predictive powers of pretest IQ, family background 
measures, and preschool attendance on children's Stanford-Blnet 
scores at age 6. As Table 3 shows, prescteol attendance 
contributed to an Increase in IQ scores independent of the effects 
of initial IQ level, child's sex and three measures of family 
background. The finding was very strong, both for the experimental 
data sets (p<.0001), and all five data sets (p<.0001). It was 
also robust; when the two strongest findings (Gray and Levensteln) 
were deleted, the result remained highly significant (p • .005). 



Because pretest IQ scores were not available for the Miller and 
Gordon data sets, they were not Included. Miller administered 
initial IQ tests after treats^t children had been enrolled in 
preschool for 6 weeks. Gordon's children were below age 2 at 
the tine of first testing; infant test scores are not comparable 
to Stanford-Binet scores (Lewis & McGurk, 1972). Palmer's 
children who besan the proj;ran at anc 2 do not have a pretest IQ 
score. . 

6(i 
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Another regrcsi.«ion analysis was performed, including the Miller 
and Gordon data sets, to assess the effects of sex, family structure, 
faaily i»i«e, maternal education and preschool attendance on IQ scores 
«t age 6. Again, preschool made an independent contribution to IQ 
at age 6, as shown in Table 4. IMs result was significant both 
for the esqjerimental data sets (p <.0001, N - 433) and for all 
■even data sets <p<.0001, N - 730). This finding was also robust; 
when the two data sets with the strongest £ values were deleted 

(Gray and Levenstein) , the result remained significant (p - .0086). 
In summary, these two analyses indicate that the increase in 

IQ scores at age 6 shown by children who had participated in 
preschool programs was attributable to the preschool experience, 

independent of the effects of sex, initial IQ, and various 

measures of family background. 

Next we turn to a consideration of children's IQ scores as 

measured by the WISC-R when the children were aged 9 to 19 years. 

Mean IQ scores of treatment vs. control groups were compared using 
^- tests. As Table 5 shows, the additional information based on 

data received since July, 1977 does not alter the earlier published 

report that effects persist for several years but are not permanent. 



1 Three data sets did not find significant results: Miller, Gordon, 
and seller. Miller's control children had somewhat ^^8^"^^ 
Tcores compared to her Head Start children, but the f J"^" 
wa. not significant. The Beller and Gordon treatment children 
h" Sigher^Q scores at age 6 than their respective controls, but 
thl difference was not significant in the subset of children used 
in this study. 
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As reported earlier (Consortium, 1977), Levenstein's treatment 
group surpassed the control group on the full-scale (p « .002); 
verbal (p " .0001) and performance (p ■ .063) scores. Palmer's 
treatment group scored higher than controls on the performance 
score (p « .041). The only project added to the analysis since 
that report (Gordon) showed no significant differences on any of 
the IQ measures.^ 

^-tests were also performed on each of the WISC-R subtests to 
compare scores of program and control children. Table 6 shows that 
generally no subtest differences appeared in projects where there 
were no IQ differences. For three projects, Gordon, Gray, and 
Weikart, there were no significant differences at all. The Miller 
project revealed no significant differences when corrected for 
multiple compar"^sons (i.e., multiplying the £ value by the number 
of subtests). Only the Levenstein and Palmer projects revealed 
statistically significant differences on subtests (after 
correcting for multiple comparisons). These differences were 
reflected in significant overall IQ differences (see Table 5). 

Variability of WISC-R IQ scores was investigated because it 
seemed plausible that early intervention might help some students 
but hurt others — for example, by making their ordinary public 

^ Gordon and Guinagh (1978) reported that children who had received 
all 3 years of the program, the first 2 years, or the second 2 
years of the program had significantly higher WISC IQ scores than 
control children at age 10. Our analysis combined into one group 
children with 1, 2, or 3 years of the program anc compared them to 
the controls. The overall results in our analyses for Gordon* s 
project found no significant differences. 
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school years seem drab by comparison. This hypothesis was tested 
by an test. As Table 7 shows, only the Verbal IQ of Gray's 
subjects and the Full Scale IQ of Palmer subjects showed 
significant differences in standard deviation. In both cases the 
controls had significantly larger standard deviations than the 
program groups. 

Table 8 shews results of the s^e analysis for the WISC subtests. 
Of the 65 comparisons of subtest standard deviations* only six showed 
significant differences, and this number was reduced to three after 
correcting for multiple comparisons: Gray (comprehension), Palmer 
(information) , and Weikart (coding) • Two of the three (Gray and 
Palmer) showed greater standard deviations for controls, one 
(Weikart) showed the opposite. Although the individual significant 
differences could be investigated, our overall conclusion is that 
there is no evidence for a general effect of preschool on the 
variance of any WISC-R full IQ or subtest score. 

In summary, only the Palmer and Levenstein projects, found 
treatment /control differences on IQ at follow-up. Gordon's own 
analyses found treatment/control differences among subjects with 
more than 1 year of the program. All these children were below 
13 years of age. In projects with children aged 13 years and above, 
there were no treatment/control differences on either the full- 
scale WISC scores or on the WISC subtests. After correcting for 
multiple tests, there were also no significant differences between 
standard deviations of the IQ scores of treacment and control groups. 
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On the basis of similar findings (that preschool did not 
permanently raise children's IQ scores compared to control 
populations) the usefulness of intervention programs was 
questioned and funds were frozen so that federally-sponsored 
programs could not expand • Therefore, it is important to consider 
what the current findings mean. 

As the Consortium (1977) reported, preschool attendance was 
associated with higher IQ scores for at least 3 years after the 
programs had ended. While an increase in IQ score is usually 
interpreted as a gain in cognitive understanding and ability, it 
may also reflect some changed behavior patterns such as more 
spontaneous verbalization, less distractability , greater task- 
orientation, more ability to cooperate with adult demands and to 
adapt to structured situations (cf. Hertzig, _et al « , 1968; 
Moriarity, 1961). The reader will notice that all the non-cognitive 
gains which could help raise an IQ score are also relevant for 
learning and performing in school. Schweinhart and Weil-vart (1978) 
propose the following explanation: 

...preschool improves intellectual functioning and 
adaptive behavior. The improvement in intellectual 
functioning fades away, but the improvement in 
adaptive behavior remains and leads to improved 
academic achievement throughout the school years. 
We offer this explanation not as a final answer, but 
as a line of thought that may be worthy of pursuit 
(p. 27). 

Because the intelligence test has been with us for 70 years, 
it is sometimes easy to forget that it is merely an operational 
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measure of "intelligence". "Intelligence" is not some bounded 
entity with a clear causal relationship to performance but a 
conceptual representation of abilities considered necessary for 
adequate functioning. But functioning within which domain? One 
thing that the IQ test does very well is to predict school grades. 
Rather than use IQ scores as predictors of school performance, 
however, it would be more useful to examine grades themselves and 
other direct indicators of school performance.*^ 

What does the IQ score mean for everyday coping ability? 
Mercer (1975) has shown that the same IQ score may have different 
meaning depending on the cultural background ol the individual. 
Lower class Blacks and Chicanps with IQs below 70 were more able 
to perform everyday chores and thus live independently than were 
middle class whites with the same low scores. Thus, in these 
senses at least, IQ scores may be said to have limited usefulness. 
In Bronf enbrenner ' s (in press) terms, there are other "more 
ecologically valid methods for assessing development-in-context 
One such method is to gather evidence of whether individuals adapt 
to and cope with the demands made upon them by specific institutions, 
e.g., the school. The section which follows contains such an 
analysis. 

^ As McClelland (1973) points out, 15 years later it is more 
important to know what level of schooling the individual 
attained rather than whether or not s/he made A's. And the 
correlation between IQ scores and level of vocational success 
is more than likely an artifact of their joint association 
with social class. 
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Table 3 



The Effect of Early Education on IQ Score at Age 6 When Background 
Variables and Pretest IQ Are Controlled 



Data Set (n) 



Pre- 
school 
Coeff . 



Signif . 

Level 

(2-tailed) 



Pooled 
z Score 



Pooled 2. 
(2-tailed) 



Approximately Experimental Design 

Gray (47) 12.971^ 
Palmer (118)^ 1.532 
Weikart (120) 4.223 

Experimental Total (285) 



Quasi-Experloental 
Seller (57) 
Levenstein (114) 

All Data Sets (456) 



4.547 
9.961 



29.271' 
.582 
5.559 



3.565 
8.969 



^.0001 
.4482 
.0204 



4.4572*^ 



.0661 
.0035 



5.5812 



'.COOl 



<.0001 



Jifitfi. Equation: IQ6 - IQPRE + MED + FP + SXBS + SEX + PC. 

Legend: IQ6 » IQ score at six years old; IQPRE - pretest IQ score; MED « mother's 
education; FP « father presence; SIBS - number of siblings; PC - preschool 
vs. control. 

* Unstandardized regression coefficient for preschool vs. control. 

^ F test for significance of preschool coefficient, simultaneous (standard regression) 
method. Figures in table are as if preschool were added after all other variables. 

c Pooled z « ."z^ ^1 - z. score from sample ± and k is number of data sets. 

vTT 



The Palmer project administered the Stanford-Binet IQ test at age 5. 



46 



Table 4 



The Effect of Early Education on IQ Score at Age 6 
When Background Variables Alone Are Controlled 



Pre- Signif. 

school Level Pooled Pooled £ 

Data Set (n) Coeff . F (2-tailed) z Score (2-talled) 



Approximately Experimental Design 



Gordon (62) 


7.090^ 


1,809^ 


.1858 


Gray (50) 


13.462 


12.582 


.0010 


Palmer (210)® 


5.796 


7.025 


.0088 


Weikart (120) 


4.833 


6.058 


.0156 


Experimental Total 


(433) 




4.8283^ <.0001 


Quas i'Exper iment al 








Seller (57) 


2.194 


.365 


.5503 


Levenstein (118) 


9.530 


7.757 


.0064 


Miller (122) 


-2.419 


.688 


(.4095)^ 


All Data Sets (730) 






4.5945 <.0001 


Note. Equation: IQ6 - 


MED + FP + SIBS 


+ SEX + PC. 


For legend, see Table 3. 



* Unstandardlzed regression coefficient for preschool vs. control. 

^ F test for significance of preschool coefficient, simultaneous (standard regression) 
■ethod. Figures in table are as if preschool were added after all other variables. 

c Figures in parentheses are in reverse direction — preschool had a negative as- 
sociation. 

^ Pooled z '^z^ See Table 3. 

W 

* The Palmer project admttiistered the Stanford-Blnet IQ test at age 5. 
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Table 5 

Mean WISC IQ Scores, Program vs. Control by Project 







Mean 


Mean IQ 


Mean IQ 


_t 


Signi- 


J 


N 


Froj ect 




Age 


Program 


Control 


ValUG 




irtm 




Gordon 


FIQ 


10-4 


83.11 


79.05 


1.26 


.210 


70 


20 




VIQ 


10-4 


82.97 


78.15 


1.52 


.132 


70 


20 




PIQ 


10-4 


85.59 


83.35 


0.68 


.499 


70 


20 


Gray 


FIQ 


16-9 


78.74 


76.44 


0.59 


.558 


34 


18 




VIQ 


16-9 


77.09 


76.61 


0.12 


.909 


34 


18 




PIQ 


16-9 


83.91 


79.44 


0.94 


.351 


34 


18 


Levenstein 


FIQ 


9-9 


101.86 


93.56 


3.21 


.002 * 


51 


25 




VIQ 


9-9 


98.41 


89.36 


3.66 


<:. 001* 


51 


25 




PIQ 


9-9 


105.45 


99.48 


1.89 


.063 


51 


25 


Miller 


FIQ 


12-8 


84.96 


87.69 


1.13 


.262 


109 


32 




VIQ 


12-8 


83.08 


85.53 


0.96 


.337 


109 


32 




PIQ 


12-8 


89.42 


92.41 


1.12 


.263 


109 


32 


Palmer 


FIQ 


12-2 


92.13 


88.86 


0.99 


.327 


104 


26 




VIQ 


12-2 


93.36 


91.25 


0.74 


.461 


104 


28 




PIQ 


12-2 


92.34 


86.39 


2.07 


.041* 


104 


28 


Welkart 


FIQ 


14-0 


81.02 


80.71 


0.14 


.885 


54 


S6 




VIQ 


14-0 


78.33 


77.64 


0.36 


.721 


54 


36 




PIQ 


14-0 


87.59 


87.82 


0.10 


.924 


54 


56 



— 

* p '[.05 before correction for multiple compa'-lsons . 
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Mean WISC Subtest Scores, Program vs. Control by Project 



Subtest^ 



ERIC 



Project 


1 


2 




3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


Gordon 
































Control 


6.11 


5. 


84 


7.79 


5.47 


7.37 


MM 


8.63 


8.11 


6.68 


6.53 


— 


7 


63 





Program 


6.71 


6. 


78 


8.53 


5.93 


7.75 




9.21 


8.03 


6.69 


7.50 


— 


/ 


• DO 





t 


.93 


1. 


34 


1.06 


.66 


.57 




.79 


.08 


.01 


1.46 






.10 





Significance 


.353 


• 


185 


.290 


.510 


.572 




.430 


.933 


.993 


.148 







.918 




Gray 
































Contirol 


5.78 


6. 


17 


7.11 


5.83 


6.17 




6.72 


7.78 


5.83 


7,06 


8.00 






M — 


Pros ram 


5.91 


6. 


26 


6.94 


6.24 


6.15 




7.38 


7.18 


6.97 


8.18 


8.24 






«... 




0.19 


0. 


13 


0.22 


0.56 


0.02 




0.74 


0.61 


1.39 


1.12 


0.24 








Significance 


.849 


.894 


.827 


.579 


.981 




.^65 


.544 


.169 


.270 


.814 








Levenstein 
































Control 


6.72 


9. 


,60 


8.08 


7.68 


8.16 


9.60 


9.04 


10.44 


8.80 


9.72 




11 


.64 




Program 


8.57 


11. 


,00 


9.94 


9.20 


9.24 


10.18 


9.75 


10.10 


10.10 


11.16 




12 


.82 




X 


3.32 


2. 


,30 


3.18 


2.41 


1.92 


.96 


1.27 


.36 


2.17 


1.92 




1 


.42 




Significance 


.001 


* 

4 


,024* 


.002* 


.018* 


.059 


.338 


.207 


.579 


.034 


* .058 






.160 
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Table 6 (Cont.) 



Subtest 



Proj ect 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


Miller 




























Control 


6.75 


7.8A 


8.09 


6.72 


9.06 


7.31 


8.94 


9.28 


7.44 


9.00 


— 


10.03 


9.09 


Program 


6.51 


7.31 


7.86 


6.35 


7.86 


7.58 


8.75 


8.76 


7.90 


8.17 


— 


8.96 


8.95 


j; 


.52 


.86 


.49 


.64 


2.04 


.39 


.36 


.89 


.59 


1.27 


— 


1.60 


,23 


Significance 


.601 


.391 


.62A 


.522 


.043* 


.694 


.721 


.377 


.554 


.205 


— 


.112 


.816 


Palmer 




























Control 


7.82 


8.57 


8.82 


8.29 


10.18 


8.54 


9.00 


8.82 


7.82 


7.32 





6.39 


10.04 


Program 


8. AO 


8.5A 


9.18 


8.55 


10.08 


9.09 


9.83 


9.75 


8.31 


8.53 


- — 


8.51 


10.17 


t 


.52 


.86 


.A9 


.6A 


2.04 


.39 


.36 


,89 


.59 


1.27 




1.60 


.23 


Significance 


.455 


.961 


.550 


.679 


.870 


.353 


.122 


.090 


.423 


.100 




.002* 


,841 


Weikart 




























Control 


5.59 


8.36 


5.89 


5.64 


6.77 




7.54 


7.93 


7.59 


7.75 




9.95 




Program 


5. AS 


8.15 


6.31 


5.93 


6.67 




7.61 


7.56 


7.70 


8.00 




10.04 




_t 


.32 


.55 


1.08 


.66 


.21 




.15 


.80 


.21 


.49 




.14 




Significance 


.7A8 


.586 


.283 


.508 


.833 




.878 


.424 


.832 


.622 




.885 





* p .05 before correction for multiple compnr isonoi 



Note. *Code to subtests s 1 ■ infonnation; 2 * similarities; 3 * arithmetic; 4 « vocabulary; 5 comprehension; 
6 - digit span; 7 ■ picture completion; 8 - picture arrangen^nt; 9 - block design; 10 ■ object assembly; 
11 * coding A; 12 - coding B; and 13 - mazes. 
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Table 7 

Standard Deviations of WISC IQ Scores, Program vs. Control by Project 







Mean 


Mean s.d. 


Mean s.d. 


F 


Signi- 


N 




iro J ec t 




Age 






V CiaLUC 






Ponfr 


Gordon 


FIQ 


10-4 


13.10 


11.09 


1.40 


.420 


70 


20 




VIQ 


10-4 


12.95 


10.82 


1.43 


.384 


70 


20 




FIQ 


10-4 


13.27 


11.85 


1.25 


.595 


70 


20 


Gray 


FIQ 


16-9 


12.11 


15.39 


1.61 


.233 


34 


18 




VIQ 


16-9 


9.59 


16.03 


2.79 


.011* 


34 


18 




FIQ 


16-9 


16.76 


15.31 


1.20 


.707 


34 


18 


Levenstein 


FIQ 


9-9 


10.98 


9.70 


1.28 


.516 


51 


25 




VIQ 


9-9 


10-80 


8.55 


1.59 


.215 


51 


25 




FIQ 


■ 9-9 


13.07 


12.68 


1.06 


.894 


51 


25 


Miller 


FIQ 


12-8 


11. 38 


14.11 


1. 54 


. 110 


109 


J/ 




VIQ 


12-8 


12.81 


12.23 


1.10 


.792 


109 


32 




PIQ 


12-8 


12.53 


15.33 


1.50 


.134 


109 


32 


Palmer 


FIQ 


12-2 


12.28 


16.20 


1.74 


.050* 


104 


28 




VIQ 


12-2 


12.84 


15.23 


1.41 


.228 


104 


28 




PIQ 


12-2 


13.63 


13.09 


1.08 


.845 


104 


28 


Weikart 


FIQ 


14-0 


11.19 


10.90 


1.05 


.846 


54 


56 




VIQ 


14-0 


9.74 


10.45 


1.15 


.604 


54 


56 




PIQ 


14-0 


13.21 


11.81 


1.25 


.411 


54 


56 



* p <.0:^ before correction for multiple comparisons. 
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Table 8 



Standard Devtatlons of WISC Subtest Scores, Treatment vs. Contiol by Project 



. Subtest* 

Project 1 2 3 4 5 6 7 8 9 10 11 12 13 



Gordon 



Control 


2.26 


3.42 


2.59 


2.20 


1. 


80 


2.61 


3.16 


3.27 


3.03 




3.04 




Program 


2.53 


2.47 


2.70 


2.74 


2. 


77 


2.84 


3.52 


3.07 


2.43 




2.62 




X Value 


1.26 


1.91 


1.08 


1.56 


2. 


36 


1.18 


1.24 


1.13 


1.54 




1.35 




Significance 


.600 


.059 


.888 


.290 


• 


045* -- 


.714 


.631 


.682 


.204 




.373 




ray 




























Control 


2.71 


3.05 


3.07 


2.96 


4 > 


19 


3.36 


2.69 


2.43 


2.80 


3.93 






Program 


1.60 


2.19 


2.41 


2.18 


1. 


91 


2.92 


3.68 


2.97 


3.74 


3.11 






F Value 


2.87 


1.94 


1.62 


1.85 


2. 


78 


1.32 


1.87 


1.49 


1.79 


1.60 






Significance 


.009 


.101 


.232 


.129 


.011* 


.482 


.172 


.384 


.205 


.243 







Levenstein 



Control 


1.99 


2.58 


2. 


34 


2. 


27 


1.84 


2.27 


2 


.61 


2, 


.22 


2.06 


3.12 




4.11 


Program 


2.41 


2.45 


2. 


42 


2. 


71 


2.49 


2.53 


2 


.09 


2, 


.64 


3.09 


3.03 




3.03 


F Value 


1.47 


1.11 


1. 


07 


1. 


42 


1.82 


1.24 


1 


.56 


1. 


.42 


2.25 


1.06 




1.84 


Significance 


.309 


.733 


• 


889 


• 


350 


.112 


.581 




.185 


1 


.357 


.034* 


.840 




.069 



SO 



Bi 



Ti,'Lle 8 (Cont.) 



Subtest 



Project 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


Miller 




























Control 


2.06 


2.94 


2.28 


2.30 


3.34 


3.37 


2.77 


3.29 


3.41 


3-03 


— 


2.97 


3.05 


Program 


2.29 


3.11 


2.36 


3.01 


2.80 


3.35 


2.51 


2.80 


2.90 


3.33 


— 


3.41 


3.22 


F Value 


1.23 


1.12 


1.07 


1.71 


1.43 


1.02 


1.21 


1.37 


1.38 


1.21 


— 


1.32 


J. 11 


Significance 


.518 


.741 


.850 


.087 


.187 


.915 


.461 


.236 


.232 


.553 


— 


.374 


.751 


Palmer 




























Contjfol 


3.93 


3.18 


2.58 


3.25 


3.35 


2.24 


2.18 


2.68 


2.75 


3.15 


— 


3.27 


3.25 


Program 


2.07 


3.04 


2.90 


2.91 


2.78 


2.90 


2.57 


2.51 


2.90 


3.49 


— 


3.05 


3.19 


F Value 


3.62 


1.09 


1.26 


1.25 


1.45 


1.68 


1.39 


1.14 


1.11 


1.23 


— 


1.15 


1.03 


Significance 


.000* 


,724 


.494 


.422 


.190 


.122 


.323 


.617 


.775 


.554 




.598 


.86 


Weikart 




























Control 


1.69 


1.93 


1.99 


2.48 


2.89 




2.54 


2.11 


3.03 


2.78 




2.57 




Program 


1.82 


2.08 


2.12 


1.95 


2.05 




2.60 


2.74 


2.60 


2.51 




3.88 




_F Value 


1.16 


1.16 


1.13 


1.61 


1.99 




1.C5 


1.69 


1.36 


1.22 




2.28 




Significance 


.595 


.588 


.6*3 


.084 


.013* 




.867 


.055* 


,259 


.460 




.003* 





* p .05 before correction for multiple comparisons. 

Note. Code to subtests; 1 * information; 2 « similarities; 3 = arithmetic; 4 « vocabulary; 5 « comprehension; 

6 * digit span; 7 « picture completion; 8 - picture arrc^gement; 9 « block design; 10 * object assembly; 
11 * coding A; 12 ■» coding B; and 13 * mazes. 



53 



Assignment to Special Education and Retention in Grade 
The most exciting result from the previous Consortium analyses 
was the finding that low-income children who had participated in 
preschool programs were more able to meet the minimal requirements 
of their schools .than were children in control groups. Treatment 
children were less likely to be retained in grade and less likely 
to be assigned to special education classes. These outcomes are 
important both to the child — as concrete evidence of maintaining 
parity with peers and progressing satisfactorily — and to society. 
For example, Weber, Foster, and Weikart (1978) conducted a benefit- 
cost analysis of the Perry Preschool program and concluded that 
(a) students who attended the preschool had higher projected 
lifetime earnings compared to students who had not attended 
preschool; and (b) economic benefits exceeded the project's costs 
because children who attended preschool did not require costly 
special education classes later in their school careers to the 
same extent that control children required such programs. 

The initial Consortium findings on special education were based 
on data from five projects and those on retention in grade (grade 
failure) on seven projects. Those findings were reanalyzed to 
include additional data received since July, 1977. In addition, 
they were extended by investigating the effects of preschool 
experience on a new dependent variable — underachievement . They 
were further elucidated by Investigating whether preschool chlldrrn 



Hi 
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maintained their superior school performance after controlling for 

background variables and IQ scores • 

Methods 

The variables used to assess school outcomes were assignment 

to special education (yes or no) , retention in grade (yes or no) 

and under achievement (a composite of special education and/or 

retention in grade and/or dropping out of school before graduation 

from high school),'^ These data were transferred from school records 

onto the School Record Form by the field staff of the individual 
2 

investigators . 

The use of these outcomes as measures of the effectiveness of 
early intervention programs has a major advantage over the use of IQ 
scores or achievement tests in that they are concrete indicators of 
whether a child has performed at an acceptable level within his/ 
her educational institution. One drawback, however, is that special 
education placement and grade retention are affected by the 
policies of individual school districts and states. Therefore, in 



Assignment to special education was coded if the School Record Form 
had been checked special education ^ unspecified) , educable or 
trainable mentally retarded, learning disabled or enKJtionally 
disturbed* Classes for children with speech and hearing difficulties 
were not classified as special education. ^Retention in grade was 
coded if the student had been retained one or more times, with the 
exception of Palmer. The types of school failure classified as 
^^retained*' by Palmer were (a) administration of a lower level 
achievement test, relative to the child's age; (b) repetition of 
grade reported on Parent or Youth Interviews; (c) assignment to 
special education classes indicated on school records; and 
(d) achieveis^nt test scores more than 2 years behind grade level on 
current achievement test. This procedure was necessary due to the 
natur*^ of Manhattan school records • 

See Appendix E for a copy of the School Record Form and Appendix A 
for attrition analyses of the School Record Form. 
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our analysis, comparisons are made within schools in the same district. 

Contingency table analysis was used to test the main effects of 
early education programs on later school performance. In reporting 
results, data sets are divided into those which closely approximate 
experimental designs and those which are quasi-experimental. This 
procedure helps insure that the most rigorous test of the hypotheses 
will be limited to the data sets with random assignment. The unit of 

analysis was individuals within projects. As explained earlier, the 
results from each project were converted to a 2^ score, and the z scores 
were summed across the projects. The combined significance level of 

statistical tests is reported separately for data sets which closely 
approximated experimental design and for experimental and quasi- 
experimental sets combined. 
Results 

Considering placement in special education classes, it is 
evident that the percentages of children so assigned varied 
considerably from project to project. This may be due to policy 
differences at the state and/or district levels or to initial 
differences between the samples. However, since treatment and control 
children are only compared within projects for these analyses, this 
variation presents no difficulties • 

As Table 9 shows, a high percentage of control children had 
been assigned to special education classes — a median of 28.6% 
across the six programs. The percentage of treatment children 
so assigned was in most cases substantially smaller — a median of 
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Another way of representing this treatment-control difference 
is shown in the Percent Reduction colusra of Table 9* Here the 
percentage of control children in special education serves as a 
baseline to indicate the likely nagnitude of special education 
assignoients for low-incone children with no preschool. By 
subtracting the percentage of treatment children actually assigned 
to special education, we arrive at a figure which indicates how 
much preschool programs can be ejqpected to reduce later placement 
in special education classes. Calculated in this way, four programs 
substantially reduced such placements. The median of the four data 
sets was a percent reduction of 61.0. 

As Table 9 indicates, the treatment- control differences were 
significant in four projects; 2x2 chi-square tests yielded two- 
tailed £ values ranging from .0044 to .06.^ Pooling the results 
from all six projects resulted in a highly significant £ value of 

.0004. This was a robust finding. When the data set with the 
most significant £ value ^Gray) was omitted, the pooled £ value 
remaiiied highly significant (p - .0098). Thus, we can safely 
conclude that preschool intervention programs significantly 
reduced placements in special education programs. 

^ The Miller and Seller projects did not find differences in favor 
of treatment children. For Miller this result was probably due 
to the initial differences between Miller's treatment and control 
groups, differences which favored the control group. The 
Philadelphia schools in Seller's project either rarely or never 
utilized assignment to special education, or did not record the 
information on school records. The percentages involve the 
following acttial numbers: one control child «id two treatment 
children assigned to sp^ial education over a period of 12 years time. 
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The second neasure of actual school performance is the 
percentage of children who have been retain^ in grade at least 
once during their school careers.^ Across the eight projects 
represented in this analysis, a median of 30. 5Z of control children 
were retained compared to a median of 25. 4Z of treatment children. 
The median reduction in grade failure across all projects was 23.1%. 

The grade- retention variable yields treatment- control 
differences similar in pattern to, but less striking than, those 
found for placen^nt in special education. The data are presented 
in Table 10. All projects except Miller's reported that more 
control children than treatment children were retained in grade. 
Only Palmer's results were statistically significant with Weikart's 
results marginally significant. Uhen the r<'^ults of the four 
studies with the most rigorous designs were pooled, the average 
»-reschool intervention prngram significantly reduced retention in 
grade (p - .0042, two-tailed). Deleting the data set with the 
best 2 value (Palmer), a £ of .0872 (two-tailed) resulted. 
Pooling across all eight projects resulted in a £ value of .0184. 
However, when the strongest daca set (P£«lmer) was omitted, the 
result was not significant (p - .1416, two-tailed). 

Finally, a composite variable was created. Labelled ''under- 
achieveaent , ** it includes students who were assigned to special 

^ There is considerable variability across projects, ranging from no 
children retained (Miller control group) to 68.62 retained (Gray 
control group). This variability reflects known variation across 
school districts in policies pertaining to retention. 
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•ducation classes and/or retained in grade and/or dropped out of 
school.^ As aho«n in Table 11, the difference between the percent 
of treatment and control children classified as underachievers was 
significant (p - .0002, two-tailed) and robust (p « .0368 after 
deleting the two most significant results ~ Palmer and Weikart 
in this case). 

In suoaiary, the new c»ata analyses confirmed our earlier finding 
children who participated in preschool intervention programs were 
more likely than control children to meet at least the minimal 
standards of their schools. This is especially true in the case 
of assigni^nt to special education classes, where the effects of 
preschool were highly significant, robust, and large. Results for 
retention-in-grade, while statistically significant across the 
projects, were only moderately robust. Analysis of the composite 
variable of underachievement resulted in significant and robust 
treatment/control differences. 

In retrospect, we feel that the weaker findings for 
retention-in-grade may perhaps be explained as follows. First, 
retention in grade is less likely to differentiate between 
treatment and control children because of widespread use of social 
promotion. Also, many more control tloan treatment children are 

^ Seller and Gray provided data on subjects who were old enough 
to drop out of school. Only two Seller cases and two Gray 
cases dropped out of school without ever repeating a grade or 
attending special classes. 
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assigned to special education classes. In our analysis, those in 
regular classrooms who failed to pass were coded as retained in grade. ^ 
Children in special education classes who reniained in special education 
classes were not coded as retained in grade. Since significantly more 
control children were assigned to special education, this raises 
the possibility that some of the worst control students (in the 
research design sense) have been differentially removed from the 
pool of students whom it was possible to retain. This is analogous 
to an attrition of the control subjects with lowest IQs: subsequent 
analyses will make the effect of preschool seem smaller than it 
really was. 

It is important to give some thought to the meaning of these 
findings. Bombarded by many hypothesis tests and results, the 
reader might be inclined to merely note the significant result and 
pass on. Instead, let us paust to briefly outline the social 
impact of this particular result. 

Many studies confirm that over the last 15 years teachers 
assigned sttidents to special education classes for a variety of 
reasons (cf. Mllofsky, 1974). Assignment procedures varied so 
widely — from building to building as well as across school districts 
and Across states — as to appear arbitrary and capricious, IQ 

a 

This includes students who at one time had been in special 
education classes but had subsequently been moved back into 
regular classrooms. 

2 

The Education for All Handicapped Children Act was passed in 1975 
in partial response to such practices. 
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scores were widely used to designate children as mental 
retardates in need of special education (with a resultant over- 
representation of minority children in such classrooms) . In 
addition, special education classes were widely used as a "dumping 
ground" for disruptive children, motivated, some suggest, by a 
wish to get rid of "undesirables" rather than to meet their special 

needs . 

It is fair to assume that the mere assignment to such classes 
affects children. They are labelled in their own eyes and the eyes 
of others. Labels such as "emotionally disturbed" or "mildly 
retarded" have a life of their own, remaining on children's records 
for years and potentially affecting each new teacher's expectations, 
for and treatment of such children. 

While not as radical as assignment to special classes, 
retention in grade may also be a blow to a child's feelings of 
self-esteem and self-worth and an occasion for teasing and 
ridicule from peers. Furthermore there are some indications 
that grade retention is no more beneficial than grade promotion, 
especially after the primary grades (Kraus, 1973). 

The value of staying in rather than dropping out of high 
school is self-evident. The individual high school graduate 
has broader choices and life-chances compared to the dropout. The 
society also gains by having members who are literate, informed 

and eiqjloyable. 

Thus, by avoiding placement in special education classes, 
retention in grade, and dropping out of school, children are 
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by-passing swaops where nany poor, minority children flounders 
the weight of an official label, «. detour into a different system 
and difficulties getting back "on track", the feelings of personal 
failure and worthlessness. 
Some Tests of Alternative Hypotheses 

The analyses just reported might be criticized on various 
grounds. This section considers several potential criticisms and 
reports reanalyses designed to evaluate their reliability. 

First, it is possible to conjecture that all these findings on 

preschool effectiveness were caused by nonrandom differences 

between treatment and control groups when perfect randomization 

did not occur. In order to investigate this possibility, the data 

were reanalyzed using standard regression analysis. This procedure 

allowed simultaneous consideration of the effects of preschool, the 

child's sex, ethnicity, and cognitive ability (as measured by initial 

IQ score), ^ family size (number of siblings), family structure (father 

absent or present), and the level of education attained by the 
2 

child's mother. The effectiveness of preschool on school outcomes, 
independent of the effects of the other independent variables, can 
then be tested by testing the statistical significance of the 

^ Stanford-Binet IQ scores except i:jr Levenstein*s project, for 
which Peabody Picture Vocabulary Test scores were used. 

2 

A soBfiwhat smaller number of children are included in the regression 
analyses due to missing data on one or more independent variables 
for about 50 students. (Attrition analyses [Appendix a] found no 
differential attrition.) The Gordon and Miller data sets were not 
used in this analysis because they had no pretest IQ scores. 
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, 1 

un»t«ndardized regression coefficient for preschool vs. control. 

As Table 12 shows, the results were highly significant: early 
education positively affected school performance independent of the 
ef facts of sex, ethnicity, family background and initial intelligence. 
With assignment to special education as the dependent variable, the 
rasult was significant (p - .0001) for both the two experimental data 
s«ts and the combined esqjerimental and quasi-experimental data sets 
(p - .0001). It was also robust; when the stiongest data set (Gray) 
was deleted, the result remained significant (p - .0226). The 
results for underachievement were similarly significant (p - .0022) 
and robust (p - .026 after deleting the strongest data set — 
Weikart). For retention in grade, the results were statistically 
•ignif leant (p - .0235) but only moderately robust (p - .105, two- 
tailed, after deleting the strongest data set — Palmer). 

Since the Miller and Gordon projects did not have pretest IQ 
data, they were not included in the analysis above. However, more 
ragression analyses which included these two groups were performed 
In order to test the effects of the various background variables 
(minus pretest IQ) on school outcomes. As Table 13 shows, the 
outcome was similar. Independent of sex. ethnicity and family 
background measures, preschool positively affected school outcomes. 
Again, the results for placement in special education classes and 



^ The computer program yielded a t for testing ef f ectiveaess of 
preschool. This t was converted to a standard normal deviate 
by the formula 'z" - df *ln(tVdf+l) with sign (z) = sign (t). 
See Darlington, 1978(b). 
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for the coaposite underachiever variable were both significant and 
robust while results for retention in grade were statistically 
significant^ but only moderately robust (p - .063, two-tailed). 
On the basis of these two sets of analyses, we can safely 



nore likely to tneet the minimal requirements of later schooling — 
and that this finding was not due to initial treatment/control 
differences in sex, ethnicity, early family background and early 
intelligence level. 

A second potential criticism is as follows. Suppose early 
education programs have a short-term effect on test-taking ability 
which appears as a temporarily inflated IQ test score. If a child's 
IQ score at first grade is in his folder, it might influence 
teachers to keep the "brighter" children out of special education 



of the IQ score at 6 years old would remove any association between 
attending preschool and placement in special education. 

This hypothesis was tested using a standard regression analysis 
with the following independent variables: preschool, IQ score at 
age 6, mother's education, father presence, number of siblings, sex 
of child, and ethnicity of child. This is an extremely rigorous test 

^ Special education P " .0028; grade retention, p - ,0387; 
uaderachievement, p ■ .0031, 

2 

In some school districts It is stated policy that children with 
IQ scores above 80 (for example) may not be assigned to special 
education. 



conclude that children benefit from preschool programs — in being 




If this hypothesis were true, then removing the influence 
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of the effects of preschool because, to the extent that IQ tests are 
a broad-scale tneasure of cognitive ability, partialling out the effect 
of IQ score at age 6 means removing a large portion of the cognitive 
effects of preschool programs (It also removes the effect of 
cognitive ability which is necessary to perform acceptably in school). 
In other words, we deliberately committed the "mistake" of partialling 
out a variable affected by the independent variable of interest; this 
makes the test more conservative. As Table shows , preschool still 
affected special education placement independently of the effects 
of sex, ethnicity, family backgro'md variables and IQ score at age 
6 (p - .0192, two-t ailed) . When the data set with the strongest 
p value '--as deleted (Levenstein) , the significance level drops to 
p " .2380, two-tailed. 

Since this is such a conservative test, it is worthwhile to 
consider the results from the projects which most closely approximated 
true experimental designs. As the table shows, for those four 
projects, preschool affected special education placement 
independently of its effect on IQ scores at age 6 (p - .0298, two- 
tailed). When the strongest data set (Gray) was eliminated, the £ 
value dropped to .1590, two-tailed, or .0795, one-tailed. 

When IQ score at age 6 was partialled out of the equation for 
grade retention, the results were not significant. They were marginally 
significant for the underachievement variable (p - .0728, two- 
tailed for the approximately experimental data sets and p » .0932 
for all data sets) . 
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P«rti*lling out IQ score at age 6 in predicting assigniaent to 
special education aetved to teat the labeling hypothesis that 
tmMr^TB identified treatment children as brighter and so were less 
lik»^^ to recosnend them for placen»erit in special classes. The 
reaults disproved the hypothesis; preschool experience affected 
special education placement apart from IQ score at age 6. In effect, 
this means that preschool must have affected the children beyond 
the purely cognitive influences of teaching concepts and skills, yet 
in ways which were related to school performance.^ 

In a sense, partialling out IQ score at age 6 has a different 
meaning when applied to retention in grade. Presumably, teachers 
primarily retain children in grade not because of differential 
labeling, but because by some objective criteria the children 
failed to master the materia^. Partialling out IQ score at age 6 
in effect removes the influence of cognitive ability necessary to 
master school material. Thus we should not really expect a 
significant effect of preschool on grade retention when IQ 
at age 6 is controlled. 

A third potential challenge to the finding in this section 
might concern the use of the individual child as the unit of 
analysis. As outlined earlier, this challenge might stress the 



This topic is taken up later in this report when we consider 
preschool^s effect on the children's achievement motivation, 
self-evaluation, and sociability, and on their parent's 
aspirations. 
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f«ct that «n «»p«ci«lly capable teacher or other chance event could 
affect an entire claaarooa of children, so that the individual 
children in the classroom are not really independent of each other 
in the statistical sense. To answer this, we might use 
the classroom as the \m±t of analysis, bringing the N down from 
about 2.000 to about 200. But classrooms might not be independent 
of each other, the hypothetical capable teacher may have taught 
in several different classes over several years, or the supervisor 
of, for example, a Montessori program nay have been particularly 
adept at selecting excellent teachers. In addition, there is 
practical problem that not all investigators could supply records 
on the exact classrooms in which each child had been placed. 

The next larger unit of aggregation is the program within a 
site — for instance, Montessori, Bereiter-Engelmann, or DARCEE. 
ypon consideration, this seemed to be the most appropriate unit 
of analysis. 

For performing an analysis at the program level, we had data 
on special education placements for 21 programs at 7 different sites, 
These 21 programs are shown in Table 28 at the end of the chapter 
on program cSharacteristics. Under the "Adjusted Difference" column 
on Table 28 is a nuaiber representing the effectiveness of that 



The next larger unit of analysis after programs is the site 
itsalf , which brings out total K down to only 12, or few^r for 
mt aialyaes, sinca not all investigators supplied us with data 
for all analyses. This if clearly too small, and it also seems 
■Miiinglass to lump completely different programs just because 
thaj occurred at the same site. 
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progrftB in reducing special education placement. Effectiveness was 
definiKi as the proportion of experitaental-group children not placed 
in special education classes, minus the comparable proportion for 
control-group classes, after analysis of covariance was used to 
adjust for any differences between experimental and control groups 
on pretest IQ scores. (The five Karnes programs and the five Miller 
programs were not used In this analysis. Karnes had no control 
group and Miller's control group was found post hoc to be different 
from the treatment group in ways favoring the controls. This left 
11 programs at five sites in the analysis,) 

label 28 shows that all 11 programs had positive effectiveness; 
that is, with remarkable consistency these programs appeared to be 
at least somewhat effective in reducing special education placements. 
This result was statistically significant by the sign test: 
p^.OOl, two-tailed. The median program was Gray's two-year 
program. In this program, .298 of the control group children were 
placed in special education classes compared to only .053 of the 
experimental-group children. (The difference of .241 between these 
two proportions became .250 when adjusted for the slight difference 
between the two groups in mean pretest IQ.) 

We may summarize our analyses of the effect of preschool 
experience on later school outcomes as follows. These analyses 
have been performed with both individuals and subgroups of the 
projects as units of analysis. Some analyses have controlled for 
pretest IQ and family background variables. Some have even 
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controlled for posttest IQ. All of these analyses have yielded 
the same basic conclusion: preschool makes a positive contribution 
to lov'- income children's later school outcomes. 



Table 9 



Percentage of Subjects Placed in Special Education Classes^^ Treatment vs. Control 



Data Sets M 


Xreatment 


Control 


Percent 
Reduction* 


Chl- 

Sauare** d 


(2-tailed> 


Pooled 

Pooled y — fa-fl^aH^ 


Closely approximating experimental design 










Gordon (82) 


23. 2Z 


53.8% 


56.9% 


5.10 


.0244 




Gray (53) 


2.8 


29.4 


90.5 


8.16 


.0044 




Weikart (123) 


13.8 


27.7 


50.2 


3.55 


.0602 




Median (258) 


13.8 


27.7 


56.9 






4.04^^ ^.0001 


Quasi-experimental 














Seller (66) 


5.7 


3.2 





.23 


(.6315)i|f 




Lcvenstein (125) 


13.7 


39.1 


65,0 


8.07 


.0046 




Miller (109) 


20.4 


12.5 




.55 


(.4654) 




Median for all 
Data Sets (558) 


13.8 


28.6 


61.0* 






3.52 .0004 


Note: Data were collected when most of the children were in the following 
12th grade; Weikart, 4th grade; Seller, 12th grade; Levenstein, 3rd 


grades: Gordon, 5th grade; Gray, 
grade; and Miller, 7th grade. 


* Percent reduction 


■ [(% control 


- Z treatment/ % control] 


• 







** Without Yatea correction. See Camilli & Hopkins, 1978. 

# Figures in parentheses are in the reverse direction; that is,, treatment was associated with an increase in 

the rate of assignment to special education* Miller and Seller results are excluded from median percef^t reduction* 

## Pooled £ ■ rx.z^ / where ■ £ score from sample i^ and k is number of data sets- 

100 



Mot 




OfttaScts in) Trofent Control 

Clo— lY approxlMtlofi fexperlaen tal design 
Gordon (65) 

Falser (221) 
VeiiEart (97) 

tfodien (433) 



Quagi-experlaental 
Bailer (66) 
Levanstein (109) 
MiUar (106) 
Zigler (144) 



27. 6X 


28. 6Z 


3.5Z 


0.00 


52.9 


68. S 


23.1 


1.12 


24.1 


44.7 


46.1 


7.66 


4.0 


14.9 


73.2 


3.42 


25.9 


36.7 


34.6 





42.9 
12.9 
7.8 
26.6 



51.6 
18.8 
0.0 
32.3 



16.9 
31.4 

17.6 



0.51 
0.39 
1.33 
0.57 



.9563 
.2907 
.0056 
.0646 



.4751 
.5307 
(.2484)* 
.4519 



Pooled z. 



Pooled £ 
(2-tailed) 



2.87 



If 



.0042 



•"J 
o 



.0184 



end Zigler, 7th & 8th grade. 

* Percent reduction - [(X control - Z treatBent)/% control]. 
** Without Yatea correction. See Camiili Sr HopUns, 1978. 
" - wee in parentheaea are in the reverse direction; that is, treatment was associated with an increase in the 
- ' ;:fr" ^tn^t^rg^He. Millar results are excluded from median percent reduction. 
#1 Fooled s *^ - z score froo sample i and k is number of data sets. 

^ERjC 



Table 11 



Percent of Underachieving Students (glaced in Special Education Classes, and/or 
Retained in Grade and/or Dropped Out of School), Treatment vs. Control 



Data set .£n> 



Treatmnt 



Control 



Pooled _2. 



Closely aPProxioatins 


exD fir Imen t al 


d9£i4 on 










Gordon (82) 


39.1 


61.5 


36.0 


2.25 


.1340 




Gray (55) 


55.6 


73.7 


24.6 


1.73 


.1882 




Falser (221) 


24.1 


44.7 


46.1 


7.66 


.0056 




Veikart (123) 


17.2 


38.5 


55.3 


6.78 


.0092 




Kadian (481) 


31.6 


53.1 


41.1 






4.09** <.OO01 


(hsasi-experiiMtntal 














Ballar (69) 


48.6 


53.1 


8.5 


0.14 


.7107 




Lavenstein (127) 


22.1 


43.5 


49.2 


4.47 


.0345 




MiUar (125) 


20.6 


11.1 




0.89 


(.3455)^^ 




Zigler (144) 


26.6 


32.3 


17.6 


0.57 


.4502 




Madiaa for 














All Data Sets (920) 


25.4 


44.1 


36.4 






3.71 ,0002 



Notaj Data were collected when most of the children were in the following grades: Gordon, 5th gradej Gray, 12th 
grade; Falser, 7th grade; Weikart, 4th grade; Seller, 12th grade; Levenstein, 3rd grade; Miller. 7th grade: 
and Zigler. 7th & 8th grade. st«"«. 

* Percent reduction ■ \\X control - % treatinent)/% control]. 
** Without Yates correction. See Camilli & Hopkins, 1978. 

# Figures in parentheses are in the reverse direction; that is, treatment was associated with an Increase in the 
rata of undsrachlevawent . Miller results are excluded from median percent reduction. 

I OS 
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## Pooled z - ^z^l where - z score from sample t and k is number of data sets . 

104 



72 



Tabls 12 

The ^^^-^"^ ^^^ y Educatlop on School Q utcomga When BAckground 
Variables and ?ti& t6atJl^ScQtBj^_CQntto^ 



Data Set 



school 
Goaf f . 



Slgnif. 

Level Pooled Pooled £ 

(2 tailed) £ score (2 tailed) 



Special Ed Placement 



Approx. Experiaantal Design 

Gray *7 
Veikart 123 
Experiaental Total 170 

Quasi-Experiffiental 

Bailer 52 
Levanatein 119 

All Data Seta 341_ 



.396* 
.119 



.005 
.206 



17.551- 
2.919 



.005 
4.946 



.0002 
.0909 



.9443 
.0285 



3.8651** .0001 



3.863 



.0001 



Grade Retention 



Approx. Experix&ental Design 
6ray 

Walkart 97 

Falner 132 

Experimental Total 273 

Quasi-Exper iaen t al 

Seller 52 

Lavenatein 104 

All Data Seta ^29 



.110 
.103 
.161 



.026 
.062 



.460 
2.390 
3.434 



.038 
.486 



.5046 
.0935 
.0667 



.8472 
.4885 



2.4122 



2.2644 



.0159 



.0235 



Uadarachteveaaat (Special Ed/Retention/Dropout) 



Approx. Experimental Design 

Gray 48 
PalAcr m 
Weikart 123 
Ekparioantal Total 303 

Quaai-Sxpcria^tal 

Bailer 55 
Levanatein 121 

All Data Sets iZi. 



.137 
.161 
.191 



-.018 
.189 



.861 
3.434 
6.033 



.019 
3.449 



.3617 
.0667 

.0157 

(.8915)c 
.0665 



2.9794 



3.06/6 



.0029 



.0022 



K^f- ifluAtlon- ACH - MED + FP + SIBS + SEX + ETH + IQPRE + PC. 

— ffir'AC^ Sp^^i.1 education placamant. in-grad. -^J^^J^^/ -"^^-.i^^,. 
^ uodar-achiavamentj MED - mother's education; FP - father presence. 

SIBS • nu«ber of aiblingaj ETH - ethnicity; IQPRE • pretest IQ score; 
106 - IQ score at 6 years old; PC - preschool vs. control. IQ 
scores - Stanford Blnat (except PP7T for Lavenatein) . 

• unataadardtxad ragraasion coefficient for preschool vs. control. 

^ « 1. for aianificaoca of preschool coefficient, aimultaacoua (standard regression) 
laJSd. li^e. iTJible Jre aa if pr«chool ware added after all other variables. 

« fl««ras in permithaaaa era in reverse direction, i.e. preschool had a negative 
«aaoei«tion vitb acbool outcomes. 




Poolad s - r«j /JTT. 
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Tftble 13 



The Effect of Early Education on School Outcones When Background 

Variables Alone Are Controlled 



Pre- 



Data Set 



n Coeff. 



Slgnif . 

Level Peeled 
(2 tailed) z_ score 



Special Ed Placement 



Gordon 53 

Gray 48 

Palmer 219 

Weikart 97 

Experimental Total 417 

Quaai-Experinental 

Seller 53 

Levenstein 107 

Miller 101 

All Data Sets 678 



.075 
.178 
.199 
.108 



.023 
.061 
■.077 



.112 
1.303 
7.227 
3.222 



.029 
.4A5 
1.286 



.7406 
,2628 
.0078 
.0767 



.8663 
.5073 
(.2142) 



2.9403 



2.0674 



Pooled £ 
(2 tailed) 



Approx. Experimental Design 












Gordon 


64 


.174* 


.937 b 


.3391 






Gray 


51 


.288 


9.745 


.0033 






Vcikart 


123 


.132 


3.485 


.0650 






Exparisental Total 


238 








3.3150 ^ 


.0009 


Quaai-Experisental 










Seller 


53 


-.011 


.027 


(.8709)*^ 






Levenstein 


123 


.238 


6.953 


.0097 






Miller 


106 


-.100 


.736 


(.3942) 






All Data Sets 


520 






2.9864 


.0028 






Grade 


Retention 









.0033 



.0387 



^nderachievcoent (Special Ed/Retention/Dropout) 



Approx. Experimental Design 



Gordon 


64 


.097 


.219 


.6429 


Gray 


52 


.208 


2.171 


.1495 


Palmer 


219 


.199 


7.227 


.0078 


Weikart 


123 


.205 


6.772 


.0106 


Experimental Total 


458 








(2uasi-Experimental 










Seller 


56 


-.029 


.048 


(.8284) 


Levenstein 


125 


.216 


4.441 


.0376 


Miller 


120 


-.123 . 


1.347 


(.2493) 


All Data Sets 


759 







3.5600 



2.9595 



.0004 



.0031 



« Equations ACH * MED + FP + SIBS + SEX + ETH + PC. For legend see Table 12. 
* Oostandardised regression coafficianf for preschool vs. control. 

P test for significance of preschool coefficient, simultaneous (standard regression) 
Mthod. Figures in table are as if preschool ware added after all other variables. 

Figures in parenthesas are in reverse direction, i.e. preschool had a negative 
acfocifttion with school outcon^. 

^ Poolad X • I«^/jfVr 

lU7 . 
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DAtia Set 



Table 14 

of Earl y F^ucaticn o n c.^o.l Onrco...^^^ 
Variables and IQ Score a t A^e 6 Are Controlled 

Signif . 

Level Tooled ^ 

(2 tailed) z score 



n 



Pre- 
school 
Coeff. 



Special Ed Placement 



Approx. Experimental Design 
Gordon 
Gray 
Veikart 

Experimental Total 
Quasi-Experimental 

Seller 

Levenstein 

Miller 
Add Data Sets 



62 
SO 

120 
232 

50 

116 
106 
504 



.198^ 

.183 

.069 



.022 
.335 
.094 



1.059^ 
3.308 
.981 



.093 
10.002 
.660 



.3101 
.0775 
.3251 

(.7633)^ 

.0021 
(.4197) 



2.3416 



Grade Retention 



Approx. Experimental Design 
Gordon 
Gray 
Paln^r 
Weikart 

Experimental Total 
Quasi-Experimental 

Seller 

Levenstein 

Miller 
All Data Sets 



51 
46 

195 
94 
386 

50 
101 
101 
638 



.014 
.070 
.148 
.080 



.063 
.140 
.064 



.004 
.179 
3.348 
1.616 



.250 
1.433 
.911 



(.9502) 
(.6765) 
.0692 
.2083 



( .6217) 
.2355 
( .3436) 



1.2977 



.8848 



Underach'evement (Special rd/Retention/Dropout) 



Approx. Experimental Design 
Gordon 
Gray 
Falii^r 
Weikart 

Experimental Total 
Quasi-Experimental 

Seller 

Levenstein 

Killer 
All Data Sets 



62 


.085 


.161 


.6911 


50 


-.043 


.076 


( .7853) 


195 


.148 


3.348 


.0692 


120 


.126 


2.768 


.0997 


427 








53 


-.085 


.484 


C4925) 


118 


.309 


6.519 


.0122 


120 


-.102 


.947 


C .3336) 


718 






0 



1.7943 



1.6785 



Pooled £ 
(2 tailed) 



2.1734*^ .0298 



.0192 



.1944 



,3763 



.0728 



.0932 



<ot«. E,a-tion: ACH - iq6 + MED + FP + SIBS + SEX + ETH + PC. For legend see Table 12, 
• • nn.t»nd«r<llzed regres.lon coefficient for preschool vs. control. 

<^ Figure m parentheses are in reverse direction, i.e. preschool had a negative 
aMOciation with achool outcomes. 
; Pooled a - Sz^/^V.. 
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Achievement Tests 
A primary goal of most infant and preschool intervention 
programs was to improve children's later school perfonaance and 
thus circumvent the familiar pattern of low-income children falling 
farther behind in school with each passing year. Avoiding retention 
in grade and placement in special education classes has been used as 
one indicator of meeting the minimal requirements of school. 
Qiildren's performance on standardized achievement tests is another 
basic indicator of whether preschool programs were successful in 
improving children's educability. 

Many of the individual projects which comprise the Consortium 
on Longitudinal Studies had published the results of. their 
comparisons of treatment and control children's scores on 
achievement tests. Two projects reported achievement test scores 
over time, and their results are apparently contradictory. Gray's 
treatment children initially scored higher than controls, but their 
advantage disappeared over time. The children were administered 
the Metropolitan Achievement Tests (MAT) Huring the springs of 
first grade, second grade and fourth grade. Treatment children 
were significantly Superior on three out of four subtests in first 
grade and on two out of five subtests in second grade. By the 
fourth grade, treatment children still scored above control children, 
but the differences were not statistically significant (Gray, Klaus 
& Ramsey, 1978). Achievement test scores showed something of a 
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"sleeper effect" in Weikart's project. Children were given the 
California Achievement Test (CAT) in grades one through eight. 
In this case, treatment children's scores were virtually the same 
as the scores of control children at the end of first grade. With 
each succeeding year the differences in favor of children with 
preschool became larger; in the eighth grade, children with 
preschool had significantly higher scores on all three (reading,^ 
language and arithmetic) areas covered by the CAT test 
(Schweinhart & Weikart, 1978). 

Results from other projects were varied. Levenstein (1978) 
reported significant differences in favor of the treatment children 
on both the reading and arithmetic subtests of the Wide Range 
Achievement Test administered at the end of the third grade. 
Palmer (1977) found that fifth grade treatment children scored 
significantly better than controls on arithmetic achievement. 
In the seventh grade treatment children scored significantly 

higher than controls on reading achievement, using the California 

1 

Test of Basic Skills (Palmer, et al . , 1978). 

Miller (1977), however, reported that her treatment and control 

subjects did not differ on -Stanford Achievement Test scores for 

2 

either reading or math at the end of sixth grade. 

^ Both Weikart and Palmer fomd significant treatment/control 
differences on reading vocabulary but not reading comprehension 
subs CO res. 

^ It is important to note once again that Miller's control group 
was initially somewhat different from the treatment group, with 
differences favoring the controls. 
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What, then, can we conclude about the effect of preschool on 
achieveaent test scorea? Once again, as in other analyses, we 
attempted to pull together the disparate findings by testing the 
null hypothesis that there is no **average" effect of preschool on 
children's achievement test performance. 
Methods 

Since achievement tests were ordinarily administered by the 

public school systems, most of the investigators were unable to 

control the precise achievement tests given to their subjects.^ 

The school systems also controlled the grades in which the tests 

were given. Nevertheless, most investigators \^ere able to find at 

least one grade in which most of their subjects had been given the 

same test, and to supply the data to us in a form which we were 

able to analyze. In particular, there were useful amounts of 

achieveiMnt test information in the fourth grade for six 

investigators — Seller, Gordon, Levenstein, Miller, Palmer, and 
2 

Wcikart* This included both mathematics and reading tests for all 
six investigators. For Palmer, however, the mathematics test 
information was most usable in the fifth grade rather than the 
fourth. 

Several Consortium members supplied data for two types of 
reading tests — scores on reading comprehension and scores on 



^ The Weikart project administered achievement tests to their own 
subjects. 

2^ 

Du^ to time constraints, we were unable to include the Gray fourth 
grade achievercnt test data in these analyses. 
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broader language-ability tests that included other language skills 
such as vocabulary. Since there were taore data on broad-gauge tests 
than on the narrower tests, we decided to limit the present analysis 
to th'i broader tests. 

Of the subjects used in this analysis, all from Seller's project 
took the 1964 edition of the Iowa Test of Basic Skills; all from 
Gordon's took the 1965 edition of the Metropolitan Achievement Test; 
all from Levenstein's took the 1965 edition of the Wide Range 
Achievement Test; all from Miller's took the California Test of 
Basic Skills; and all from Weikart's took the 1957 edition of the 
California Achievement Test. Some of Palmer's subjects took the 
1970 edition of the Metropolitan Test, and some took the 1972 edition 
of the Stanford Achievement Test. For the Palmer project only, a 
dummy variable was included in the regression equation measuring which 
of these two tests was taken. This meant that data for the two tests 
were in effect analyzed separately and the results then combined. 

Regression analysis was used separately for each investigator 
and for each test — math or reading. Since this analysis involved 
six investigators, this made a total of 12 regression equations. 
The independent variable was preschool attendance. Age was included 
u a covariate or control variable partly to correct for any bias 
introduced by the fact that some children might score better on 
fourth grade achie^remcnt tests because they were the age of 
typical fifth graders but had been retained in grade a year. In 
addition, the child's sex and pretest IQ (available only for 



79 



Seller, Miller , and Palmer) were entered into the regression as 
covariates. 

For each regression, the computer program yielded a t^ for 

testing the effectiveness of preschool. This t^ was converted to a 

2 

standard normal deviate by the formula {z | - df*ln(t /df+l)+l) , with 
sign (z) - sign (t) {from Darlington, 1978b). The six £ scores thus 
obtained for any one type of test (math or reading) were then 
COTbined in two different ways, depending on the unit of analysis. 
Vlhen the individual child was the unit of analysis, the scores were 
combined by the formula z - ^/ik Mntioned in the section on methods. 
When the project was the unit of analysis, the mean and standard 
deviation of the six scores were computed just as if the scores were 
six raw scores on some measure. An ordinary _t test was then used 
to test the null hypothesis that the mean of the five scores was 0. 
Results and Conclusions 

The results of these analyses are shown in Table 15. Treatment 
children showed a significant advantage over control children in 
mathematics achievement, while the verbal achievement scores showed a 
suggestive trend in the same direction. The difference in 
mathematics scores was highly significant regardless of whether the 

^ The reader will recall that Miller administered IQ tests to 
treatn«nt r 'd control children after treatment children had been 
enrolled in preschool for 6 to 8 weeks. Thus, the pretest IQ 
measure was not statistically independent of the effects of the 
treatment. This artifact for this particular analysis would favor 
control rather than treatment children. In general, covariance 
analysis undercorrects for such biases, and so the analysis still 
•lightly favors the controls. 
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unit of analysis was the individual child (p - .008, two- tailed; 

p - .0016, one-tailed) or the project (p - .007, two-tailed; 

p « .0014, one-tailed). 

For reading ability, the child-level and project-level £ values 

were .14 and .30 (two-tailed) or .07 and .15 (one-tailed) respectively. 

The former figure could be considered at least a suggestive trend. 
It should be pointed out that the significance levels observed 

with mathematics were small enough to survive correction for the 

fact that they were the better of two results — math and reading. 

We thus conclude that on the average preschool does appear to have 

some positive effect on achievement test scores. 

Although significant, are the effects under discussion large 
enough to be of practical interest? The dependent variables in 

our analyses were raw scores or simple oonotonic transformations 
of raw scores. Thus we were unable to compare the sizes of the effects 
across projects because different projects used different achievement 
tests. However, some rough idea of the size effect we are considering 
can be gained as follows. On the mathematics test, if we rank the 
six projects in the order of the significance of their differences, 
one of the median projects is Seller's. 1ti the Seller project, the 
difference between tre&tment and control groups, controlling for 
Age, sex, and pretest IQ, was .52 grade-equivalents. This figure 
give* Bome idea of the size effects we are considering. Even if 
estimation error has affected this quantity somewhat and the true 
difference is only half as large as .52, the difference is still 
Urge enough to be of considerable practical interest. 



Ill 



81 



Table 15 

Fourth Grade Treatment-Control Diff erodes 
on Achievement Tests 



Matheoatics 



Proj ect 


iL 








Seller 


50 


1.620 


45 


1.580 


Gordon 


41 


1.871 


36 


1. 804 


Levensteln 


45 


.300 


40 


296 

• &i 7 U 


Miller 


82 


.894 


77 


.886 


Palmer* 


89 


1.437 


84 


1.420 


Weikart 


95 


1.233 


90 


1.221 


Analysis with child 


as unit of analysis: 






Slim of 6 z's " 


7.207; 


z - 7.207/Vl" - 


2,942; p 


• .UlJo, two- tailed 


Analysis with project as unit of analysis 


■ 

* 




Mean of 6 a5*s - 1.201; 


Standard deviation of 


6 z*s « .543 


t - 1.201/(.543/',b) - 


5.419; df - 5; 


p - .007, 


two— ta lied 






Reading 






Project 




1. 




-a. 


Seller 


50 


.804 


45 


.793 


Gordon 


41 


.618 


36 


.608 


Levenstein 


45 


2.170 


40 


2.085 


Miller 


82 


.000 


77 


.000 


Palmer 


89 


-1.442 


84 


-1.424 


Weikart 


95 


1.542 


90 


1.523 


Analysis with child 


as unit 


of analysis: 






Sum of 6 z's " 


3.585; 


z - 3. 585/ V 6 - 


1.464; p 


- .14, two- tailed 


Analysis with project as unit of analysis; 






Mean of 6 z ' s - 


.598; 


Standard deviation of 5 


z's - 1.229 


t - .598/(1. 229/ "t/6) - 


1.191; df - 5; 


P - .30. 


two-tailed 



* Fifth grade data 
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NON-COGNITIVE EFFECTS OF PRESCHOOL 

Attitudes and Values 
We turn now to an investigation of non-cognitive outcomes of 
preschool intervention programs. Two related interests have guided 
this search. First is the fact that many intervention programs, 
including those comprising the Consortium, specifically set 
non-cognitive goals such as increasing children's self-esteem 
(Seller, Deutsch, Gray), enhancing social and emotional development 
(Gordon, Karnes, Miller) and influencing attitudes related to 
school success (Gray). As mentioned previously, Head Start goals 
also include the stimulation of social development. Clearly, it is 
of interest to know whether preschools succeeded in meeting these 
goals. 

Additionally, we approach non-cognitive outcomes in the context 
of strong and robust evidence that preschool positively affected 
children's school performance and that it affected other than 
cognitive attributes — i.e., effects existed even after partialling 
out the effects of preschool on IQ. There can be no question of the 
outcome. But by what process did it come about? It seems unlikely 
that one or at most 2 years of preschool experience could protect 
children against future school failure for the succeeding 10 to 15 
years. Perhaps analysis of non-cognitive outcomes will provide 
clues to the nature of the intervening processes. 

In nwst casep, the early intervention programs inaugurated in 
the 1960s made assumptions, implicitly or explicitly, about 
intervening processes which would explain the school failure of 
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low-income children. Low-income children were described as in need 
of earichaent. Because of the nature of their past experience, the 
children lacked achool-relevant skills and concepts, motivations, 
and goals for the future. Consequently, they were at high risk of 
school failure (see for example. Bloom, Davis, & Hess, 1965). It 
was reasoned that by intervening early in the child's life, s/he 
could be provided with learning experiences relevant to school and 
the parents could be taught how to support and teach him/her more 
effectively. 

The preceding description contained the following simple 
model for social change. Preschool programs teach children concrete 
skills and concepts. But skills and concepts must be built upon 
over the years, so children must also be motivated to continue to 
learn and achieve in school. They must believe that school is 
important and possess enough self-confidence to exert the 
necessary effort. The preschool experience should also affect 
parents so that they nay support their children's efforts. With the 
backing of new abilities, motivations, values and parental support, 
children should be better able to compete with their middle-class 
peers. 

This simple model may be tested to some degree and non-cognitive 
outcomes assessed by using data from the Youth Interviews and the 
Parent Interviews collected by the Consortium in the 1976-77 follc5w- 
up study. ^ The Youth Interview covered educational expectations. 



For a copy of the two interviews, see Appendix f. 
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occupation*! aspirations, attiti^es toward school, current 
OBploynent status, leisure time activities and interests, social 
interaction with family, peers and the larger community, and 
attitudes toward oneself and others. The Parent Interview covered 
such topics as household composition, socio-economic status, 
parental aspirations for and evaluations of their child, information 
on the child's nedical history, the parent's current relationship 
with the child, and parental assessment of the intervention 
program. 

Four content areas were explored in the current analyses: 
(a) mothers' aspirations for their children, (b) children's 
achievement-orientation, (c) children's self-evaluations, and 
(d) children's social relationships and social participation. 

Maternal aspirations for their children have bean included 
because so many intervention programs were ejqilicitly aimed at 
fostering change in parents as well as children. Further, our 
model stipulated that persistent treatment effects of preschool 
intervention programs are partially mediated through the family. 
One possible route, for example, may be that preschool programs 
initially improve the child's school performance, thus affecting 
the mother's expectancies. This change in maternal attitude (and, 
presmaably, behavior) could in turn constitute a "treatment" lasting 
well beyond the intervention program itself. 
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Achlev«unt<-orientation includes achievement notivatipn and 
those values, attitudes, norms and goals which seem important for 
success in school and later jobs (cf. Kahl, 1965). In general, 
e^lrical evidence supports the conclusion that achievement orientation 
in Its different forna can play an appreciable independent role in 
determining academic success (Spenner & Peatheroan, 1977). Our 
"model" predicted that treatment children would show more evidence 
of achievement orientation thsixi controls. 

Self -evaluation (or self-concept) has also been identified as an 
important factor contributing to academic success (e.g., Raizen, 
et al. , 1974). Anderson and Evans (1976) posited a model similar 
to the one presented here in which self-concept is both a cause of 
achievement — through its effect on achievement-orientation — and 
an effect of actual achievement. 

Sociability and social participation are not so clearly related 
to academic success as the previous three constructs. Gregariousness 
or extroversion might be considered important in the sense that 
extremely withdrawn or bashful children would be at a disadvantage 
in the classroom situation (Kohn. 1977). However, sociability outside the 
schoolroom — specifically, participation in peer groups — could 
plausibly have both positive and negative effects. For example, 
members are orginarily expected to conform to the group's norms to 
a high degree. If the group norms were anti-adult and anti-school, 

^ Typically defined as the individual's striving to succeed, either 
In cMpetition with others or in comparison to a set of standards 
(McClelland, 1955). 
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peer group participation would have negative itaplications for 
future school tuccess. On the other hand, musical and athletic 
peer groups would involve systematic training and practice relevant 
to the participants* occupational goals (Schulz, 1966). It would 
seem useful to describe the extent and kind of social activities 
in which the children participated. However, lacking detailed 
prior evidence on the relationship of sociability to academic 
performance, it seems prudent to refrain from hypothesizing, a 
priori, treatment/ control differences. 
Methods 

In order to assess the four areas of non-cognitive outcomes of 
preschool intervention programs, 15 items were selected from the 
Youth Interview and one item from the Parent Interview for use as 
dependent variables."^ An additional six dependent variables were 
created, which were not independent of the original 16, for a total 
of 22. Table 16 provides a suosnary of the labels, sources, and coding 
of the dependent variables. Further coding details may be found in 
Appendix E. 

These data were analyzed in two ways: (1) treatment (i.e. 
preschool vs. no preschool) main effects and (2) interactions of 
treatment with sex and with age on the dependent variables. The 
unit of analysis was individuals within projects. The association 
between treatment/control status and each of the dependent variables 



^ For a aore detailed dcecription of the hypotheses, procedures and 
results, see Daniel M. Koretz, Long-term non-cognitive effects of 
seven infant and preschool intervention programs. Cornell 
University, University Microfilms, 1978. 
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was calculated separately for each project. Then, the results were 

pooled acroas projects by converting the £ values to z;-scores and 

ausMlng the ^-scores. 

The mala treatment effects were scrutinized within sex and 

within age groups. For example » the various projects were dichotomized 

into an "old** group (subjects aged 15 to 19) and a "young" group 

(subjects aged 9 to 13) and the analysis performed separately to see 

whether the age groups differed • Interaction analyses of treatment 

by sex» treatment by age and treatment by sex by age were also 

2 

performed within projects and the results then pooled. 

As is our common practice, the significance levels of 
statistical tests were adjusted to correct for large nusdser of 
significance tests which were made. In this case, the correction 
factor was derived separately for each of the four domains: 



For dichotomous measures, the phi coefficient was used* For 
ordinal measures, the point-biserial correlation was used. 

2 

For treatiMnt by sex, a multiple regression was run with treatment, 
sex, and the product of treatment and sex as predictors. The 
significance of the beta weight of the product was the significance 
o£ the interaction. For treatment by age, the main effects of 
treatment were pooled across projects within each age groups 
yielding one pooled ^ score for the older projects and another for 
the younger projects. The interaction was then tested by the 
, formula: 

2 * ^old " Vung 
-J2 

Testing treatment by sex by age interactions involved combining 
the above two procedures. The within-saxsple sex by treatment 
interactions were pooled across each age group and the two 
resulting jc scores used in the fonmxia above. The last step in 
each of these procedures was simply to convert the z score to a 
p value. 
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Achleveiaent orientation (nine variables) « family context of 
achievement orientation (four variables), self-evaluation (two 
variables) and sociability (seven variables). 

The analyses were performed on the seven projects with the 
most complete data as of July, 1977: Beller, Gordon, Gray, 
Levenstein, Miller, Palmer, and Weikart**^ A total of 702 Youth 
Interviews and 747 Parent Interviews were collected by these 
investigators* 
Results 

A broad picture of all children's aspirations (combining 
treatment and control groups) compared to their parents" positions 
in life provides a perspective on the treatment/control comparisons 
which follow. As Table 17 shows , the aspirations of these low- income 
predominately Black children far exceeded their parent's attainments 
Most children aspired to white collar jobs; their parents were 
largely semi-skilled or unskilled employees. The children planned 
(not hoped) to attend and to complete college; parents at most had 
gradiiated from high school. Interestingly, other investigators 
studying lower-class Black youngsters report similar high 
aspirations and e3q)ectations (cf. Spenner & Feathermant 1977). 
Similarly, all the children rated themselves somewhat better in 

^ For various reasons (e.g«, incomplete interview data from some 
projects)* all seven were not necessarily included in each of 
the analyses » 
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school performance relative to their peers (see Table 20). In 
addition, 79Z said they got along well with their families, 85Z 
reported that they had "special friends" and 49% reported 
participating in organized community-wide activities. , 

Let us turn now to the consideration of treatment/control 
differences in the four areas of noncognitive outcomes. 
Faaily Context of Achievemmt-orientation 

A plausible esq^lanation of enduring effects of preschool 
intervention prograxas is that parental expectations and behaviors 
were changed, enabling parents to further support and motivate their 
children. The four vu. ables under "family context of achievement-- 

orientation" provide a picture of one aspect of parental 
expectations: mothers* occupational aspirations for their children. 
Table 18 provides a suanaary of the results of comparing mothers of 
treatiaent (preschool program) children and the mothers of control 
children. 

As Table IBA shows, there was a trend associating preschool 
attendance with higher maternal occupational aspirations for their 
children. In four of six projects treatment mothers had higher 
aspirations- for their children compared to control mothers. In the two 
exceptional cases, the differences were essentially zero. The 
overall trend across the six projects was marginally significant 
(p - .065, two-tailed). 

The strongest finding, however, involves variable 3; when 
esked "what kind of job would you like (your child) to have later 
in life," Bothers of children who had attended preschool consistently 
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responded with occupations which were higher than their children's 
answers to the same question. Mothers of control children varied; 
sone had higher occupational goals and some had lower goals for 
the child than the child had for himself. (For convenience, the 
difference between the mother's aspirations for the child and the 
child's own aspirations is called the "discrepancy score.") This 
treatment/control difference in discrepancy scores was statistically 
significant across projects — p « .0056, two-tailed, or p • .023 
after correction for multiple comparisons. It was also robust; 
deleting the strongest result (Gordon), the overall result was 
significant at the .031 level. These data are shown on Table 18B. 

To summarize, there is some evidence that preschool changed 
the family context, and thus, perhaps, laother-child interactions, 
with respect to achievement orientation. Mothers of treatment 
children had higher vocational aspirations for the children than 
the children had for themselves. Additionally, mothers of 
treatment children tended to have higher aspirations for their 
children's future vocations than did mothers of control children. 
Children' s Achievement-Orientation 

Before reporting the results of hypothesis-testing in the area 
of achievement orientation, the coding of "achievement-related" 
responses must be explained. The reader will note that variables 

^ See Table 19A for children's responses. 
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9» 10, li, 12, and 13 on Table 16 are dichotomous variables with 
siibjects' responses coded as either achievement-related or not 
achievement-related. Deriving a code proved difficult, primarily 
due to conceptual ambiguity of the construct of "achievement- 
orientatlont" which contains both attitudinal and motivational 
cooponents (among others). It was not always possible to distinguish 
responses reflecting one aspect from those reflecting another. 
Therefore, responses were classified as "achievement-related" if 
they reflected either a high level of achievement imitivation or 
a high value placed on presumably school-relevant activities and 
traits. The actual response categories and their coding may be 
found in Appendix E along with analyses of the construct validity 
of these particular variables. 

The reader will recall the high educational expectations and 
occupational aspirations voiced by all the children. As Table 19 
summarizest there was no difference between treatment and control 
children's educational expectations. Treatment children in older 
projects showed a slight tendency (p » .091) to report lower 
vocational aspirations (Table 19A) . There were no differences in 
the areas of employment and leisure activities. 

The strongest finding was for attitudes toward the self; when 
asked to "tell me something you've done that made >du feel proud 
of* yourself ", children with preschool experience were far more 
likely to respond with achievement- related reasons (such as 

school or job achievements, straightening oneself out, helping 

12S 
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out at hone ) rather than other reasons (such as good behavior or 
altruistic acts). This result was significant — p • .0025, two- 
tailed or p - ,023 when corrected for multiple comparisons. It 
was also robust (i.e., still significant when the project with 
strongest results was removed) . It is also consistent across 
projects (p - .032, two-tailed, by the sign test). Table 19B 
presents these data. As is evident, the y 'nger projects and older 
projects differed only slightly. However, breaking down the sample 
further by sex as well as by age revealed an interesting difference. 
As Table 19C shows, the treatment effect was similar for males and 
females in the younger projects. For older projects the treatment 
effect was significant for females (p ■ .005) but not for males 
(p - .2!;4). Although our complex pooled-z^ significance tests were 
not performed on individual items, treatment girls were more 
likely to name school-related reasons or helping at home as bases 
for feeling proud of themselves. In contrast, control girls more 
frequently said they were proud of having babies or said they had 
no reason to be proud of themselves. 

In suiaaary, some areas of achievement motivation appear to 
be affected by preschool experience and others do not. The 
strongest treatment effect was on children's attitudes toward 
themselves; children who participated in preschool were more 

^ Helping out at hoa« was coded as achievement-related because it 
ordinarily constitutes an onerous chore and does represent work 
activity as opposed to non-work responses such as good behavior, 
etc. For relevant construct validity analyses, see Appendix E. 
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likftly to report feeling proud of themselves for achievement- 
related re&soQS than were control children. This was especially 
true for girls. The result is particularly interesting since the 
question, 'Sirhat makes you feel proud of yourself?" represents 
something of an interface between achievement estivation and self- 
concept. 

Children's Self -evaluations 

Children normally engage in the procass of comparing themselves 
to others and judging their own prowess and standing relative to their 
peers. There were two questions on the Youth Interview ^ich 
attespted to tap such social comparisons as a means of measuring 
self-esteem. One asked the children to judge their own academic 
performance relative to others in their class and the other asked 
how well they got along with the other members of their household. 

Table 20 presents the data concerning children's evaluations 
of their own academic performance. It is noteworthy that both 
treatment and control children rated themselves somewhat above their 
peers. While there was no overall treatment-control difference, 
there was a small difference in the older projects: treatment 
subjects rated themselves higher than did controls. Although the 
difference was not significant in any one project alone, it was 



^2? 
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significant when the three older projects were taken together 
tp - .039).^ 

Analysis of the children's self-evaluation of getting along 
with other hoiisehold meters revealed no treatment-control 
differences. 

In sum, only two interview items were categorized as self- 
evaluation items. One revealed no treatment effects on children's 
self-appraisals of their compatability with their families while 
the other indicated that treatment children in the older projects 
had slightly but significantly more favorable self-evaluations 
of their own academic performances. These results are summarized 
in Table 21. 

Children's Sociability and Social Participation 

The dependent variables included in these analyses are presumed 
to tap different aspects of this general domain. Variables 16 and 
17 (the amount of participation in organized community activities) 
and variables 18 and 19 (the amount of contact with "special friends") 
were used to describe patterns of social interactions. As the 



^ The small size of differences and the problem of multiple comparisons 
make it seem likely that the difference is merely due to chance. 
However, further scrutiny of the data suggests that there is a true 
age difference, m all the younger projects, controls rate themselves 
aore highly than do tr««t«mt chUdran and the reverse is true in all 
oldar projects. Accordingly, the treatment by age interaction is 
significant at the .03 leval, two-taUed. Such a clear association 
between age and the direction of tha differences is unlikely to occur 
by chance alone Cp - .057, two-tailed, by Fisher's exact 2x2 test). 
Essentially identical age pattern* appeared in the construct validity 
analyses (Appendix E), lending further credence to the view that this 
difference is developmental rather than due to chance. 
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suaaaries on Table 21 show, none of the treatment-control differences 
was striking in this domin. In the area of patterns of social 
interaction, approadmately 85% of both treatment and control 
children reported participating in organized community activities. 
There was no significant difference between treatment and cnntrol 
children in reporting the existence of special friends (Table 21A) . 
Among children in the older projects, there was a marginally 
significant trend (p - .069) for treatment children to report 
spending less time with special friends compared to controls 
(Table 21B).^ Taken together, the results of r.^se four 
variables suggest that while treatment children report themselves 

to be as socially active in organized community activities as 

2 

control children, they (especially girls) may tend to spend less 
time with close friends. Some might interpret this positively, 
as an indication of social autonomy. However, Ladner (1971) argues 
persuasively that female adolescent peer groups provide vital 
sources of emotional support and positive socialization in low- 



Xf broken down further by sex, this treatment-control difference 
was marginally significant among females (p " .052, two-tailed) . 
The sex by treatment interaction, however, was not significant. 

If broken down further by sex, these data indicate that treatment 
females tended to be less likely to report having special friends 
(p ■ .072, two-tailed). Treatment-control differences were small 
and Inconsistent among males. The sex by treats^nt interaction 
however, was not significant. 
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Income Black consuanitles. As mentioned earlier, there Is no detailed 
prior evidence on the relationship of sociability to academic 
performance, further complicating interpretative efforts. Thus, 
we report this slight trend as part of our exploratory research but 
will refrain from theoretical Interpretations. 

Variables 20 and 22 (sociability ratings of school and spare- 
time activities) were used as fissures of social attitudes and, 
indirectly, of children's own gregarlousness. 

Treatment-control differences were again small or nonexistent. 
When asked to tell "what is the best thing about school," children 
who had attended preschool were more likely than controls to respond 

with sociability-related answers, such as being with friends and 

2 

meeting new people (p ■ .041). Table 21C contains these data. 
Table 21D shows a non-significant trend (p - .081, two-tailed) for 
treatment children to respond to "what do you do in your spare time" 
with answers such as "play with friends" or "talk on the phone" 
compared to children in control groups. These results are only 
trends; but it seems fair to conclude on the basis of these variables 
that preschool experience apparently did not impair children's 
sociability. 

^ Stack (1974) also documents the crucial importance of female ties 
with kin and flctive kin ("special friends") in the social 
organisation of Icwer-class Black communities. 

^ Thia result should be interpreted cautiously. Sociab ill ty-^r elated 
responses wcj : relatively Infrequent across all projects; thus, some 
of the scores reflect the responses of only a few individuals. 
Furth^raore, the strongest results were from the Levensteln project, 
which had a self-selected control group. This, In conjunction with 
the failure to remain significant after correction for imiltlple 
comparisons, suggests that the result should be seen as a suggestive 
trend oaly« 
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Susacaary and Conclusions 



These analyses of non-cognitive outcomes were exploratory: we 
knew preschool had positively affected children's school performance 
and that it affected more than just cognitive ability. The question 
was: what was affected? Investigators in the 1960s suggested it 
would be important to influence children's achievement motivation 
and self-esteem and to affect parents^ attitudes as well. As 
detailed above, there is some indication that preschool affected 
those areas. For treatment but not control children, nK>thers' 
aspirations for the children were higher than children's 
aspirations for themselves. This and other trends suggest that 
preschool may have affected the familial context with respect to 
achievement orientation* Compared to control children, preschool 
children were w>re likely to give achievement-related reasons for 
being proud of themselves. This was especially true for girls. 
Older treatment children rated themselves as superior to their 
classmates in school performance and tended to have lower (and, in 
this context, irore realistic) vocational aspirations. 

Although many of the other results were only trends, the reader 
should remember that these measures were administered 10 to 15 
years after the children participated in preschools. In view of 
thia, these findings lend credence to the hopes that attitudes 
could be changed and that such changes would persist. 

Head Start and other programs were initiated in the 
hope that changing children's abilities and attitudes would be 
instrumental in extracting them from poverty. This appears naive 
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in retrospect. Unemployment for Black youngsters (approximately 
90Z of our subjects) was 39X in 1976 and has not substantially 
improved to date. Furthermore, Black unemployment for all ages has 
been twice that for whites since World War II (Kenniston, et al. , 
1977) . The relationship between level of educational attainment 
and later vocational status has historically been very low for 
Black persons. For example, a college-educated Black male can expect 
to attain the average job and income level of a white male with no 
more than a high school diploma (Ogbu, 1978). It seems important to 
recognize that preschools can make a difference, but that the 
larger society and its institutions must also change in order to 
fulfill the promise of preschool for low-income children and 
their families. 
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Table 16 

Dependent Variables for Analyses of Noti'^cosnltive Outcott^s 



Variable 



Question #^ 
on Interview 



Code 



Family context of child^s aspirations 

1. Mother's occupational aspirations 
for own child 

2. Percentage of mothers stating that 
child's vocation is up to him/her 
to decide 

3. Discrepancy between mother's and 
child's vocational aspirations 

4. Absolute value of the discrepancy 
betveen mother's and child's 
vocational aspirations 

Achievement^orientation 

5. Educational expectations 



6* Occupatloaal asplratlona 

7. Whether and vhere child is paid 
eaployee 

8. Amount of paid work 

9* Achlevement-orientatlon of spare- 
time activities 

10. Achievement^orientation rating of 
''best things about school'* 

11, Achievement-orientation ratings of 
"worst things about school" (worst 
things • achi-2vement) 



#16 (P) 
#16 (P) 



#16 (P) 

#16 (Y) 

#16(P) 
#16 (Y> 



#2<Y) • 

#16 (Y) 
#15a(Y) 

#15c(Y) 
#8(Y) 

#3(Y) 

#4<Y) 



Seven point Holllngshead Scale 



Percent of all mothers in group 



Algebraic discrepancy score 



Absolute value 



1 - cos^lete grauiaar sctwol to 8 * 
graduate or professional training 

Seven point Holllngshead Scale 

1 - no paid work; 2 - paid work at hone; 
3 « paid work outside home 

1 • no paid work to 4 « full time work 

1 - achievement-- related; 0 * other (multiple 
responses summed) 

1 - achievement-related; 0 • other (multiple 
responses summed) 

-1 - achievement-related; 0 « other (multiple 
responses summed) 
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Variable 



Table 16 (Cont.) 

Question #^ 
on Interview 



a 



Code 



130 



12 m nAohi^e»^at^ctf ten tattoo ratings of 

rea^onis foF being proud of oneself \^ 

13* Achievement-orlentatlon ratings of 

reasons for admiring the inost admired 
adult 

Self- evaluation 

14 « Self *-evaluat ion of academic 
performance 

15- Self-evaluation of household harmony 



D. Sociability and Social Participation 



^23(Y) 



//5(Y) 
#22 (Y) 



^hiip:v«2aervt*rei-atad; 0 mother 
-1 - achievement- related; 0 * other 



1 ■ much worse than others to 5 « much 
better than others 

1 « get along with them badly to 5 ■ get 
along very well 



16. 


Participation in organized community 
activities 


#6(Y) 


1 « yes; 0 no 




17, 


Frequency of participation in 
organized activities 


^6(Y) 


liumber of times per Mnth 




18. 


Has "special" friend(s) 


#7(Y) 


1 « yes; 0 ■ no 




19. 


Frequency of contact with "special" 
f riend(s) 


#7(Y) 


Number of times per month 




20. 


Sociability ratings of "best 
things about school" 


#3(Y) 


1 « sociability-related; 0 - 
(multipi.«2 responses summed) 


other 


21. 


Sociability ratings of **worst 
things about school" 


#4(Y) 


-1 - sociability- related; 0 
(multiple responses summed) 


" other 


22. 


Sociability ratings of spare time 
activities 


#8(Y) 


1 • sociability-related; 0 - 


other 



o 
o 



a 
b 



(Y) - Youth Interview; (P) - Parent Interview. 
Sec Appendix E for details on coding decisions 



See Appendix for Youth and Parent Interviews, 
for these items. 
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Table 17 

Educational and Occupational Attainment of Parents and Aspirations 
of Children, Treatment and Control Pooled 



Mean Mode • 

Father's Education 10.1 years 12 years 

Mother's Education 10.4 years 12 years 

Child's Educational Aspirations some college complete college 

Father's Occupation (Hollingshead) 6.0 7 

Mother's Occupation (Hollingshead) 6.7 7 

Child's Desired Occupation 

(Hollingshead) 3.2 2 

Mother's Desired Occupation for 

Child (Hollingshead) 2.7 2 



Key to Hollingshead Occupational Codes: 

1. Higher executives, proprietors of large concerns, and major 
professionals. 

2. Business managers, proprietors of medium-sized businesses, 
and lesser professionals. 

3. Administrative personnel, small independent business, and 
minor professionals. 

4. Clerical and sales workers, technicians, and owners of 
"little businesses." 

5. Skilled manual employees. 

6. Machine operators and semi-skilled employees. 

7. Unskilled employees. 

(Hollingshead, 1957) 

*Data on parents are from the time of the child's entry into the 
intervention program. 
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Table 16 
Sunsaary of Treattaent Effects 
on Family Context of Achievement Orientation 



Variable 



Difference (2-tailed significance level 
uncorrected for multiple comparisons) 



!• Mother* s occupational 

aspirations for their children 

2. Percent of mothers stating that 
their child vocation la the 
child* s own decision 



3« Discrepancy between mother's 
aspirations for child and the 
child's own aspirations 



Trend for treatment mothers to have 
higher aspirations (p ■ .065) 

No significant difference by parametric 
methods; however ^ difference favored the 
treatment mothers in 5 of 6 projects 
(p - .09 A, by Wilcoxon signed- ranks test), 

Treatxs^nt nujthers' aspirations are higher, 
relative to those of their children than 
are those of control mothers relative to 
their children's (p - .0056), (.023 when 
corrected for multiple comparisons.) 



4. Absolute discrepancy scores 



No difference. 
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Table 18A 





Mean of Mother's 


Occupational Aspirations 


for Child, 








Treatment vs. Control 


(Holllngshead Code)" 






Project (q) 


All Children 


Treatment Control 


Difference 




£ (2- tailed) 


Young Projects (ages 9-13) 
Gordon (6B) 

WWf WWII ^ WW ^ 


2.57 


2.54 


2.67 


** 

-.13 


-.038 


.756 


Levenstetn (64) 


2.42 


2.24 


3.00 


-.76 


-.225 


.074 


Miller (132) 


0 "71 

Cm 1 i 


2.74 


2.70 


.1/4 


.009 


(.914)" 


Palmer + (58) 


0 no 


1.83 


2.75 


QA 


one. 


.U04 


Mean 


2.44 


2.34 


2.78 


-.44 




.055 


Old Projects (ages 15-19) 
Seller (72) 


2.83 


2.88 


2.80 


.08 


.025 


(.836) 


Gray (34) 


3.59 


3.38 


3.92 


-.54 


-.158 


.372 


Weikart tt 














Mean 


3.21 


3.13 


3.36 


-.23 




.626 


AH Projects 


2.69 


2.60 


2.97 


-.37 




.055 


* Lower numbers correspond to higher aspirations; see Table 17 for key. 
*♦ A neqative difference score indicates that the treatment mothers' aspirations are higher. 

t All male sample. 
tt Data not usable. 

1 Figures in parentheses are in the reverse direction. 
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Table i8B 



Mean Discrepancy Between Hother's Occupational Aspirations for Child and Child's 
Own Aspirations, Treattnent vs. Control (Based on Holllngshead Codes)" ^ 



Project in) 



All Children Treatment 



Control 



Difference 



pb 



jl (2-tailed) 



Young Projects (ages 9-13) 














Gordon (57) 


-.70** 


-1.02 


.20 


-1.22*** 


-.260 


.050 


Levenstein (41) 


-.41 


- .52 


-.21 


- .31 


-.103 


.520 


HIlTer (125) 


-.64 


- .60 


-.76 


.16 


.033 


[ .712;? 


ralBier ^ \0o} 


— . ao 




.17 


- .97 


-.241 


.082 


mm _ 

Hean 


CO 
-.00 






- 59 




.018 


Old Projects (ages 15-19) 














Beller (64) 


-.31 


- .77 


-.07 


' .70 


-.106 


.112 


Gray (32) 


-.31 


- .70 


.33 


-1.03 


-.247 


.172 


Weikart 














Mean 


-.31 


- .74 


.13 


- .87 




.047 


All Projects 


-.49 


- .74 


-.06 


- .68 




.0056 



ititft 

I 



See Table 17 for Holllngshead Code. . ^ ^, „ . ^ u 

These results are based on a smaller sample than Tables 18A and 19A, since all cases in which either the child' 

aspirations or the mother's aspirations were missing had to be dropped for this analysis. 

A negative score indicates that the children aspired to a lower level of status than did their mothers. 
A negative difference score indicates that the aspirations of the treatment children are lower, relative to 
their mothers', than the control children's are, relative to their mothers'. 

All -wale sample. I ^ 

Ottta not usable. 

Figures In parentheses are in the reverse direction. 
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Table 19 
Sumnary of Treatment Effects 
on Achievement- Orientation Variables 



Variable 



Difference C2*-tailed significance level 
uncorrected for multiple comparisons 



5. Children's educational 
expectations 

6. Children's occupational 
aspirationa 

7. Whether and where employed 

8. Amount of paid work 

9 • Achievement-orientation 
ratings of spare-time 
activities 

10 . Achievement-orientation 

ratings of '*the best thing 
about school" 

11 « Achievement-orientat ion 

ratings of "the worst thing 
about school" 

12* Achievement-orientation 

ratings of reasons for being 
proud of oneself 

13. Reasons for admiring most 
admired adult 



No difference 

No significant difference across all projects. 
Trend in older projects for treatiKnt 
children to have lower aspirations (p * «091). 

No difference 
No difference 

Control greater chan treatment (p ■ *044) • 
No difference if athletics not classified 
as achievement«*related. 

No significant differences across all projects, 
Trend in younger projects for treatment 
children to have higher ratings than control , 
(p * .063). 

Parallels #10, but not significant. 



Treatu^t greater than control (p - .0025). 
(*023 when corrected for multiple comparisons.) 

No difference 
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Table 19A 

Mean of Children's Occupational Aspirations. Treatment 
~" vs. Control (HolUngshead Code)* 





All Children 


Treatment 


Control 


Difference 


PD 


jt(2-taned) 


Young Projects (ages 9-13) 
Gordon (81) 


3.26 


3.42 


2.65 


** 

.77 


.176 


.116 


Levenstein (72) 


3.15 


3.10 


3.25 


-.15 


-.043 


(.720) 


Miller (134) 


3.38 


3.35 


3.48 


-.13 


-.032 


(.710) 


Palmer t (130) 


2.83 


2.78 


3.00 


-.22 


-.055 


(.538) 


Mean 


3.16 


3.16 


3.10 


.06 




.91 


Old Projects (ages 15-19) 
Seller (93) 


3.11 


3.52 


2.88 


.64 


.178 


.088 


Gray (49) 


3.80 


3.94 


3.53 


ill 

.41 


• iUu 


. •tOc 


Welkart (63) 


3.75 


3.89 


3.64 


.25 


.065 


.616 


Mean 


3.55 


3.78 


3.35 


.43 




.091 


All Projects 


3.33 


3.43 


3.20 


.23 




.231 



* Lower numbers correspond to higher aspirations; see Table 17 for key. 
t All male sample. 

*♦ A positive difference score Indicates that the treatment children's aspirations are Tower. 

# Figures in parentheses are in reverse direction. 
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Table I9B 



Percent of Children 


Giving Achievement-Related Reasons 


for Being 






Proud 0 


f Themselves, 


Treatment 


vs. Control 






Project (n) 


All Children 


Treatment 


Control 


Difference 


« p 


(2- tailed 


Young Projects Cages 9-13) 














Gordon (85) 


85.9% 


88.2% 


76.5% 


11.7% 


.135 


.218 


Levenstein ++ 












— 


Miller (141) 


77.3 


78.9 


71.9 


7.0 


.070 


.408 


Palmer t (102) 


72.5 


77.8 


52.4 


25.4 


.230 


.020 


Mean 


78.6 


81.6 


66.9 


14.7 




012 


Old Projects (ages 15-19) 














p6i ler \sO 1 


fi5 It 
QC • 1 m 




fin CA 




.057 


.584 


Gray (50) 


68.0 


75.8 


52.9 


22.9 


.232 


.106 


Heikart (64) 


81.3 


86.2 


77.1 


9.1 


.115 


.364 


Mean 


70.5 


75.9 


63.3 


12.6 




.078 


All Projects 


74. 5« 


78.8% 


65.1% 


13.7% 




.0025 



^, All male san^le. 
Data not available. 
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Table 19C 




Young Projects 
(ages 9-13) 



Males (including Palmer +) 
Males (excluding Palmer) 



Treatment Control Difference 
8Z.9X 72.2 X 10.7 X 
B2.15 3.35 



85.5 




68.35 13.55 
75.4 % -00.7 % 



Old Projects 
(ages 15-19) Females 

t Palmer's sample Is all male, 
tt Data not available for Levenstein's project. 



77.6 



53.5 



24.1 



US 
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Table 20 



Mean of Children's 


Self-Evaluations of Their Overall 


School Performance 




Relatr 


ve to Their 


Peers, Treatment vs. Control' 




Project (n) All 


Children 


Treatment 


Control 


D1 f f erence 




p (2-ta11ed) 


Young Projects (ages 9-13) 














auruun \ycj 


Ct to 


£ . O 1 


2.70 


.11 


.053. 


V .0 1 


Levenstein (75) 


2.63 


2.66 


2.56 


.10 


.051 


(.662) 


Killer (141) 


2.84 


2.86 


2.78 


.08 


.045 


( 596) 


Palmer t (144) 


2.67 


2.69 


2.59 


.10 


.052 


(.538) 


Mean 

* 


2.73 


2.76 


2.66 


.10 




(.301) 


uio rrojecus \ages 














Beller (96) 


2.63 


2.43 


2.74 


-.31** 


-.167 


.104 


Gray (50) 


2.74 


2.70 


2.82 


-.12 


-.115 


.428 


Ueikart (69) 


2.64 


2.52 


2.74 


-.22 


-.144 


.236 


Hean 


2.67 


2.55 


2.77 


-.22 




.039 


All Projects 


2.70 


2.67 


2.70 


-.03 




.566 



* 1 * Much better than others In your classes; 3 * About the same aa others; 5 " Much worse than others 
t All male $«i^>1e. 

♦ A negative difference score Indicates that the treatiwnt group's self-evaluations were higher than 
those of the controls. 

# Figures In parentheses reflect negative findings. 
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Table 21 



Siwinary of Treatment Effects on Self-Evaluation 
and Sociability Variables 



Variable 



Difference (2-taned significance level, 
uncorrected for multiple comparisons) 



Self-Evaluation Variables 

*k. Self-evaluation of academic 
performance 

15. Self-evaluation of how well one 
gets along with those with whom 
one lives 

Sociability Variables 

16. Participation In organized 
conmunlty activities 

17. Frequency of participation 
In organized conmunlty 
activities 

18. Whether one has "special" 
friends 



19. Frequency with which one gets 
together with special friends 



20. Sociability ratings of the 
"best things about school" 

21. Sociability ratings of the 
"worst things about school" 

22. Sociability ratings of spare 
time activities 



No significant difference across all projects. Treatment 
higher than control In older projects (p ■ .039) 

No difference 



No difference 
No difference 



Non-s1gn1f1cant trend (d « .12) for treatment children to 
be less likely to report having special friends. Margin- 
ally significant among fanales (p « .072); Inconsistent 
and non-significant among males 

No difference across all projects; marginally significant 
(p " ,069) trend toward lower frequencies among treatment 
children In the older projects. Marginally significant 
among (all) females (p « .057), but Inconsistent and non- 
significant among males 

Treatment greater than control (p « ,041) {.246 when 
corrected for multiple comparisons} 

No variance 

Treatment marginally greater than control (p » .082) 



Table 21A 

Percent of Respondents Who Stated that They Have "Special Fri end?" With 
Whom they Spend Time. Treatment vs. Control 

Project (n) All Children Treatn^nt Control Difference $ p (Z-talled 

Young Projects (ages 9-13) 
Gordon (92) 
Levenstein (74) 
Miller (141) 
Palmer t (144) 



Mean 


90.5 


89.8 


92.3 


- 2. 


.5 




.439 


Old Projects (ages 15-19) 
















Seller (96) 


82% 


71% 


89% 


-18. 


.0% 


-.216 


.034 


Gray (50) 


78 


82 


71 


n. 


.0 


.128 


(.374) 


Weikart (72) 


76 


69 


82 


-13, 


.0 


-.161 


.178 


Mean 


78.7 


74.0 


80.7 


- 6, 


.7 




.137 


All Projects 


85.4% 


83.0% 


87.3% 


- 4 


.3% 




.119 



t All male san^le. 

# Figures in parentheses are in the reverse direction. 



1 i ^ 



91% 


90% 


95% 


- 5.0% 


-.069 


.512 


93 


92 


96 


- 4.0 


-.072 


.544 


91 


89 


97 


. - 8.0 


-.114 


.178 


87 


88 


81 


7.0 


.088 


(.296) 
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Table 2 IB 



Heart Frequency with which Respondents Spend 


Time wfth "Special 


Friends 




(Tfmes 


per month) , 


Treatment 


vs. Control 






Project (flj 


All Children 


Treatment 


Control 


01 f f erence 




(2-ta11e(l) 


Young Projects (ages 9-13) 
















If) QO 


Ifi 7R 


17 "^7 




- fl47 


.655 


levenstein (75) 


17.39 


17.28 


17.60 


- .32 


-.025 


.834 


Miller (140} 


17.26 


17.11 


17.75 


- .64 


-.042 


.622 


Palmer t (112) 


14.95 


15.39 


13.33 


2.06 


.103 


(.278) 


Mean 


16.63 


16.64 


16.51 


.13 




.981 
















Seller (96) 


14.88 


12.80 


16.07 


-3.27 


-.195 


.056 


Gray (50) 


11.12 


10.88 


11.59 


- .71 


-.040 


782 


Weikart (70) 


13.20 


12.05 


14.16 


-2.10 


-.118 


.330 


Kean 


13.07 


11.91 


13.94 


-2.03 




.069 


All Projects 


15.10 


14.61 


15.41 


- .80 




.227 



i All Bale sawle. 

I Figures in parentheses are In the reverse direction. 



Table 21C 



Moan Soelabnitv Ratings of "The 


Best Thj^ngs 


about School 


tt 

-Z. 








Treatment vs. 


Contro? 








Project tn) An 


Children 


Treatment 


wun iri w i 


rn ^fprence 

will CI WIIVW 


r . 

^pb 


J. (2-ta11ed 


Young Projects (ages 9-13) 














Gordon {88) 


.15 


.14 


.16 


-.02 


.015 


(.890)* 


Levenstein (75) 


.20 


.30 


.00 


.30 


.289 


.012 


Kiner (141) 


.05 


.06 


.00 


.06 


.124 


.144 


Palwer + (144) 


.10 


.10 


.13 


-.03 


.034 


(.686) 


Mean 


.13 


.15 


.07 


.08 




.086 


Old Projects (ages 15-19) 










.142 


.166 


Del ler 


.26 


.34 


.21 


.13 


Gray (50) 


.00 


.00 


.00 


.00 


.027 


.830 


Wetkart (66) 


.03 


.04 


.03 


.01 


Mean (excluding Gray) 


.15 


.19 


.12 


.07 




.263 


All Projects (excluding Gray) 


.13 


.16 


.09 


.07 




.041 



* 1 - soclabfllty-rclatcd; 0 - other (multiple responses simned) . 
t ATI mate sample. 

I Figures in parentheses are in the reverse direction. 
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Table 210 





Mean Sociability Ratings of Spare-Time Activities 


t 








1 1 CO wlltd Ik V 3 ■ 












All Children 


Treatment 


Control 


Difference 




D f2-tailed 
















Gordon (87) 


.48 


.40 




-.It 


-.090 


(.406)* 


Levenstein ++ 










— 


-- 


Miller (141) 


38 


38 


38 


.00 


.0008 


.922 


Palmer + (144) 


.33 


.37 


.19 


.18 


.154 


.066 


Mean 


.40 


.40 


.38 


.02 




.562 


Old Projects (ages 15-19) 














Beller (95) 


51 


47 


52 


-.05 


-.039 


(.708) 


Gray (48) 


.08 


.13 


.00 


.13 


.223 


.128 


Welkart (96) 


1.08 


1.23 


.96 


.27 


.216 


.034 


Mean 


.56 


.51 


.49 


.12 




.061 


All Projects 


.48 


.51 


.44 


.07 




.081 



* I ■ sociability-related; 0 « other (nuiltlple responses summed). 
t All fnafe sample. 

tt Data r>ot available. 

# Figures In parentheses are In the reverse direction. 
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Use of Title IV Child Welfare Services 

As pointed out earlier, Head Start included in its goals the 
improvement of family functioning. Most of the preschool programs 
comprising the Consortium predated H2ad Start, but they, too, were 
concerned to some degree with family welfare. As a result, we 
\indertook an e^qploratory study to determine whether there would be 
treatment/control differences in the families' use of Title IV 
child welfare services.^ Four of the Consortium projects agreed to 
take part in this follow-up. Because the agencies providing service 
data were assured that the reporting of this research would protect 
specific information sources, the projects will not be identified by 

name. 
Methods 

The gathering of data for this study served to test the 
feasibility of using archival records to measure program impacts. 
Archival records are less costly to obtain than data generated by 
observation, testing or interviewing. Each of the four participating 
projects was asked to submit to the Cornell staff one list of treatment 
children's names, addresses, birth dates, and parents' names and a 
separate list of control children's names, etc. Any identifying 
labels were removed. In each of the four corresponding states, the 
director of the division responsible for the administration of Title 
IV child welfare services was then contacted and sent a request form. 



^ For more details, see Marilyn Rosche; Early intervention and later 
use of child welfare services. Unpublished Master's Thesis, Cornell 
University, 1979. 
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The form asked for the total number of children from each list who 

had received any child welfare service (overall use) , and then asked 

that the figures be broken down for each type of service provided. 

Thus, any child who had received multiple services would be counted 

several times under the breakdown by service type but only once in 

the overall usage tally."*" Thus, the Cornell staff received from each 

agency data pertdiining to two lists — one for treatment and one for 

control children — making a treatn^nt /control comparison possible. 

This procedure circumvented the confidentiality issue. Since none 

of the service information gathered could be linked to a particular 

subject, it was not necessary to obtain the subjects' consent to 

have the information released. Considering the financial and time 

limitations ordinarily imposed on research efforts, such an approach 

enables investigations which otherwise might be impossible to 
2 

consider. 

The available data differed somewhat for each of the four 
projects as follows. The preliminary contact with State A revealed 



Information was requested for services provided over the past 5 
years rather than at any time during the child's life on the 
assumption that such a request would be more favorably received 
than one requiring a more extensive search. 

The data do not provide as much information, of course, as would 
a first-'hand scrutiny of individual case records. For instance, 
this research does not permit us to determine whether those children 
who received child welfare services are the same individuals who 
failed in school or were placed in special education classes « 
However, an indication of treatment/control differences in service 
usage might encourage individual project staff to obtain subjects^ 
consent to examine case records. 
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that the requested information was not available at the state level 
but could b« obtained through the appropriate county offices. Since 
all of the subjects were originally located in one county, this 
presented no problem. State agency personnel forwarded the 
request to county staff, who sent their responses directly to 
Cornell. However, any subjects who might have moved to another 
county and subsequently received services would not be included.^ 

Personnel from State B arranged to send the available information 
to Cornell through their computerized case- tracking system. Based 
on Individual client transactions as reported by caseworkers, this 
information is used not only by the division providing child welfare 
services but by the courts and residential facilities as well. 
Rather than including all services which might be categorized as 
child welfare, the data received by Cornell were limited to 
records of substitute care arrangements and accompanying counseling. 
Since the con^uterized system began in 1976, the accuracy of the 
data is questionable prior to that time. These data, then, must be 
considered an underestimate of service usage over the past 5 years. 
In addition, it was difficult to differentiate between various types 
of substitute care arrangements based on the information provided. 

State C also used a computerized data system to gather the 
requested information. Their response to Cornell Included usage 



^ Although this could conceivably result in a lower proportion of 
subjects reported as having received services, there is no reason 
to believe that it would differentially affect the experimental 
and control groups. 
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figures for a dozen service categories as well as overall use. The 
data were generated from computer file records which were activated in 
1975. Cases initiated prior to the change over to this system were 
included providing the case was listed as "active" in 1975. Cases 
initiated and terminated before that time would not have appeared 
in the read out. 

Since child welfare services in State D are locally 
administered, contact was made with the appropriate city agency 
rather than the state* However, the city agency was unable to 
provide the requested information. As an alternative, contact was 
made with a private information system which gathers data on foster 
care placements. This agency was able to provide data on current 
foster care placements for the children or their siblings. 
Results 

Project A . The response from State A included data for total 
service use, plus a breakdown into 11 service categories: adoption, 
day care, family and individual counseling, family planning, health 
related services, housing improvement, information and referral, 
interstate/intercounty, protective services for children, services 
for unmarried parents, and transportation services. Comparisons 
of the frequency of service use revealed no significant differences 
between experimentals and controls. The proportion of the sample 
receiving any service ~ approximately 50% for both treatn^t children 
and controls — was far higher than for the other projects. 
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Project B . In addition to the figures reflecting overall 
service use. State B provided data for five types of substitute care 
arrangement plus counseling services. None of the experimental 
children were reported as having received any services; six control 
children were included in the overall service category. ^ A chi- 
square test of significance showed this difference to be 
significant at the .05 level (two-tailed). The treatment-control 
difference in use of foster care services was also significant 
(p <.05, two-tailed). None of the comparisons in the other service 
categories (adoption, counseling, halfway house, institutions, 
shelter care) reached significance. 

Project C . The response from State C included figures for 
overall service use plus a breakdown into 12 service categories: 
child protection services, counseling for emotionally disturbed 
youth, education and training services, family counseling services, 
family planning, foster care, health related services, home 
management, housing and home improvement, juvenile services in the 
community, social service planning services, and unmarried parent 
services. Although proportionately more experimentals than 
controls were reported as having received any type of service 
(overall use), this difference did not approach significance. None 
of the treatment/control comparisons in the 12 service categories 

were significant. 

Project D . Two categories of service status were reported by 
the data system contacted for information: the first indicated 
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that the subject was under foster care; the second indicated that 
the subject was not under care himself but one or more of his 
siblings were. No other service categories were included. None of 
the control children appeared in either category; four experimental 
children were under care and an additional two eacperimental children 
had siblings under care. These differences were not statistically 
significant. 

In general, participation in preschool intervention programs 
apparently did not affect the incidence of use of Title IV child 
welfare services. However, the data collection method devised for 
the study proved workable. It avoided problems of confidentiality 
and was both .elatively rapid and inexpensive. Such an approach 
may prove fruitful in future explorations of program outcomes. 



122 



DIFFERENTIAL EFFECTS OF PRESCHOOL 

Which Children Benefit Most on WISC-R Test Scores ? 
The reader will recall from results reported earlier in this 
report that in comparisons of treatment and control children on the 
WISC-R IQ tests (administered in 1976-77) only Levsnstein and Palmer 
foimd differences on the full, verbal, and/or performance scores 
and the subtests. Further analyses seemed warranted, however, to 
check the possibility that interaction effects were present; that 
is. that certain kinds of children (e.g., boys vs. girls) had 
benefitted from preschool while others had not. On the basis of 
earlier work (Murray, 1977) we chose to investigate sex of child 
and other's level of education. Mother's education had a strong 
positive correlation with the children's WISC-R scores and with 
earlier Stanford-Binet IQ scores . Sex was linked to different 
patterns of relationship between IQ and various demographic 
variables (Rubbell, 1977; Murray, 1977). 

Work by other investigators has found differential effects 
of these variables. For example. Black females scored much higher 
than males on IQ and scholastic achievement tests. As adults, 
Black women had more education, were more likely to fall in the 
highest occupational categories and had higher income compared 
to Black males (Jensen, 1971; Sowell, 1973). 

The relationship between socioeconomic status and various 
measures of academic ability and performance has been extensively 
documented (cf. Boocock, 1972). Family SES is usually measured by 
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three status variables: (a) level of parental occupation(s) ; (b) level 
of education attained by parents; and (c) level of family income. Most 
professionals would agree that these and other measures of SES are 
merely convenient indicators of the sociopsychological environment 
of the family — aspects such as power relations » values, interactional 
patterns, parental e>^ectations, etc. These psychological correlates 
of SES probably link parental SES to children's achievement. Lacking 
more refined measures of the family environment, we must depend on 
the indicator variables for all analyses in this report. Since 
almost half of the families in our data bank were single-parent 
families and since many families derived their income from welfare 
payments (with payment levels varying across states) , we decided to 
use mother's educational level as the best indicator of the family 
SES. In addition, mother's education is of interest because there 
could be a direct relationship between the mother's education and 
the children's IQ and academic performance. Since OK^thers are 
generally the primary parental caretakers of children under age 5, 
their influence may be correspondingly strong. And it is at least 
feasible that more educated mothers impart different values, 
attitudes and motivations relevant to school success to their 
children than do less educated mothers. 
Methods 

Once again, as was true for the earlier analysis of WISC-R, 
the projects were analyzed individually and results were not later 
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pooled. First the effects of sex were examined by investigating 
thm correlation between sex and the WISC full, verbal, 
perfomance and subtest scores. Then an analysis of variance was 
perfonaed to investigate the combined effect of preschool attendance 
and sex. 

Mother's level of education (as reported before children began 

2 

preschool programs) was first correlated wir.h the WISC-R scores. 
The combined effect of preschool attendance end mother's education 
was investigated b> using multiple regression. Tlie linear terms 
of preschool vs. no preschool and level of mother 'i9 education were 

3 

entered and then their crossproduct was entered into the equation. 
Results 

First we will consider the two interaction analyses. An 
ANOVA was performed with the factors of sex and preschool 
attendance. There were no significant interactions on either the 
full, verbal or performance IQs or the subtest scores. Thus, 



Palmer had only male subjects and thus was not included in this 
analysis. 

^ For the WISC analysis only, the variable of mother's education is 
different for Gordon's project. For WISC analysis, the mother's 
educational level reported in the 1976 Parent Interview was used. 
Since the Gordon project specifically encouraged mothers to go 
back to school, it is no surprise that mothers of program 
children reported significantly higher irean education after as 
compared to before the program (pre-prograra xaean - 10.69; 1976 mean 
mean - 11.54 years; t - 3.69, p - .001). In interpreting 
Gordon's data, one should remember that the effects of preschool 
education and mother's education may be confounded for WISC 
analysis. 

^ Had any of the above analyses warranted, all three variables — 
preschool attendance, sex, and mother's education — would have 
been included in a multiple regression equation. 
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there vas no indication that early childhood education had 
differential effects with respect to sex on WISC-R full or subtest 
scores • 

A multiple regression analysis was perfom^d using the linear 
terms of maternal education and preschool attendance and then 
entering their crossproduct in the equation. There were no 
significant interaction effects for mother* s education and preschool 
att^dance on VISC-*R full or subtest scores. Thus^ there was no 
evidence that preschool differentially affected the IQ scores of 
children whose mothers had completed different years of education^ 

In the process of performing the interaction analyses, both 
sex and maternal education were correlated with the WISC-R 
scores. The results of those correlations are presented briefly 
here for interested readers. 

Regarding the correlation between sex and WISC-R scores, only 
the Weikart project showed a significant correlation. As Table 22 
shows, boys scored higher than girls on full IQ, verbal IQ and 
performance IQ. This relationship disappeared, however, upon 
correcting for multiple con^arisons. On subtest scores (Table 23), 
boys scored significantly higher than girls in three of the five 
projects on Picture Conviction, with boys in Miller's project 
showing a similar tendency. The most consistent significant 
correlations were found in the coding B subtest; girls performed 
better than boys in all projects. Other subtests revealed no 
significant correlations after correction for multiple comparisons* 
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As Table 24 shows, there was a positive correlation between 
mother's education and verbal IQ in all six projects. Three 
projects — Gordon, Palmer, and Weikart — found a positive 
correlation between mother's education and performance IQ. 
Considering the subtests (Table 25), Vocabulary had the strongest 
relationship to mother's education (five projects significant; 
thx«e significant after adjustment for multiple coraparisons) with 
less consistent patterns of significant positive correlation for 
the other verbal subtests. The only performance subtests with 
reasonably consistent positive correlations were Digit Span and 
Coding. 

In summary, only a few subtests correlated significantly 
with sex. In contrast, there was a patten: of significant positive 
correlations between mother's education and WISC-R scores, 
especially on verbal subtests. Despite these correlations, there 
were no significant interactions. When WISC-R scores were used as 
the outcome measure, there was no evidence that preschool benefitted 
girls more than boys or vice-versa or that children whose mothers 
had different levels of education benefitted more or less from 
attending preschool. 
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Table 22 

Correlation of Sex vtth WISC-R IQ Scores, by Project 



Project (n) 




Correlation 




Significance 
(two-tailed) 


Gordon (90) 


a 

PIQ 


.0890 




.202 




D 

VIQ 


.1709 




.054 






-.0240 




.411 


Gray (52) 


FIQ 


-.0369 




.398 




VIQ 


-.0772 




.293 




PIQ 


.1198 




.199 


Levenstein (76) 


FIQ 


-.0212 




.428 




VIQ 


-.0691 




.277 




PIQ 


.0372 




.375 


Miller (141) 


FIQ 


.0358 




.337 




VIQ 


.0766 




.183 




PIQ 


-.0167 




.422 


Weikart (110) 


FIQ 


.2100 




.014* 




VIQ 


.2044 




.016* 




PIQ 


.1674 




.040* 


* p < .05 before 


correction 


for multiple 


comparisons. 





Full IQ score. 



Verbal IQ score. 
Performance IQ score. 

Positive correlations indicate boys scored higher than girls. 
Negative correlations indicate girls scores higher than boys. 
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Table 23 

Correlation of Sex with WISC Subtest Scores, by Project 



Subtest 



Project 

Gordon 

Correlation^ 
Significance 

Gray 

Correlation 
Significance 

Levenstein 
Correlation 
Significance 

Miller 

Correlation 
Significance 

Weikart 

Correlation 
Significance 



10 



11 



1147 .1132 .1137 .0740 .0746 
145 .148 .147 .248 .246 

,0888 -.0192 .0148 -.0887 -.2783 



,266 



.446 .459 .266 .023" 



.1208 -.0809 .1372 -.0300 

.133 .228 .103 .391 

.3025* .2040 .0609 .2105 

.015 .073 .334 .067 



,2091 
,068 



.0600 .0258 -.2558 .0948 .0737 -.1245 .2385 .0424 .1627 

.303 .412 .013* .208 .264 .142 .019* .358 .080 

.0358 -.0599 .0705 .0293 .0253 -.0156 .1357 -.0008 .1205 

.047* .240 .203 .365 .383 .427 .054 .496 .077 



.1659 .0807 .1136 .2158 .1411 
.042* .201 .119 .012* .071 



.4012 .0555 .1230 
.001* .282 .100 



1107 
,171 

.1176 
.082 

.2674 
.002* 



12 

-.2805 
.004* 



.3194 
.002* 

-.4081 
.001* 

-.3030 
.001* 



13 



.1008 
.117 



* p \:'.05 before correction for multiple coniparisons . 

* Code to subtests: 1 - inf oimation; 2 - sin>ilarities; 3 - arithmetic; 4 - vocabulary; 5 - cotaprehension; 
6 - digit span; 7 - picture completion; 8 - picture arrangement; 9 - block design; 10 - object assembly ; 
11 ■ coding A; 12 - coding B; and 13 « mazes. 

^ Positive correlations indicate boys scored higher than girls. Negative correlations indicate girls scored 
higher than boys. 
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Table 24 



Correlaclon of 


Motner's 


Education with WISC 


IQ Scores, by Project 


Project (n) 




Coirelation 


Significance 

\ kiW V ua XX ^Vl^ 


Cnr c?nn fQO\ 


a 

XT X\l 


d 






b 

V JLV^ 








c 


7797 


nn7* 
« uu / 








O ft Q 
• ZOO 




V i-V^ 










n/, 1 Q 






T7Tn 
r Ivj 


• X LZo 


• XOO 






• Zx / J 






FIQ 


_ ni 77 










• uxo*^ 




V il^ 


• Z X? X 


• uu^** 




f iQ 


1 1 7R 
• XX / o 


• XU D 


Palmer (132) 


FIQ 


.2666 


.001* 




VIQ 


.2686 


.001* 




PIQ 


.1644 


.030* 


Weikart (110) 


FIQ 


.2790 


.002* 




VIQ 


.2574 


.003* 




PIQ 


.2398 


.006*. 



* p 05 before correction for multiple comparisons. 

^ Full IQ score. 

^ Verbal IQ score. 

Performance IQ score, 

^ Positive correlations indicate boys scored higher than girls* 
Negative correlations indicate girls scored higher than boys. 



Table 25 

Correlation of Mother's Education with WISC Subtest Scores, by Project 



Pro j ect 



Gordon 

Correlation 
Significance 

Gray 

Correlation 
Signif Icance 

Levenstem 
Correlation 
Significance 

Miller 

Correlation 
Significance 

Falser 

Correlation 
Significance 

Weikart 

Correlation 
Significance 



Subtest 



4 . 



10 



11 



12 



.2614 .2147 .3777 .2085 .1766 

.011* .030* .001* .034* .062 

.0754 .1812 .1410 .1474 .2521 

.300 .102 .162 .151 .037* 



.1845 .2090 .2042 
.054 .034* .037* 



.1391 
.114 



-.0198 -.0262 -.1282 -.0588 .0303 
.445 .428 .185 .341 .416 



1664 -.1148 .1073 .3107 .1907 .2221 -.0022 -.0244 -.1352 -.0728 



,075 



.162 .178 .003* .049* .027 .493 .417 .122 



.1093 .1481 .0422 .2533 .1558 .0071 .0072 .0703 .0151 

,120 .055 .326 .003* .047* .470 ,469 .226 .436 

,2394 .2158 .1595 .2688 .2525 .2011 ,U95 1118 .1245 

,003* .007* .035 * .001* .002* .011* .044* .103 .080 



.266 

.0138 
.441 

,QQ51 
.477 



,2542 .1981 .2199 .1925 .0978 
,004* .019* .010* .022* .155 



.1332 .0257 .1581 .0697 
.083 .395 .395 .050* 



.2571 
.012* 



* P 
a 



.05 before correction for multiple comparisons. 
Code to subtests: 1 - information; 2 - similarities; 3 - arithmetic; 4 » vocabulary; 5 



6 ■ digit span; 7 
11 - coding A; 12 



picture completion; 8 - picture arrangement; 9 - block design; 10 
coding B; and 13 > mazes. 



- comprehension; 
object assembly; 



13 



,1368 
. 119 

.2239 .2090 
vQ0,8* .012* 

.1244 .0747 
.078 .198 

.2888 
.001* 



O 
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Which Children Benefit Most on School Performance ? 

The reader will recall that earlier analyses concluded that 
children who participated in preschool programs were less likely to 
be assigned to special education classes or retained in grade later 
in their school careers. These were striking and important findings. 
However » it is possible that these results were obtained because 
preschool helped only the children who were already brighter or 
who came from somewhat more advantaged backgrounds. This hypothesis 
had been raised before (Bronf enbrenner , 1974) and there is some 
evidence to support it (e.g., Herzog, Newcomb & Cisin, 1974). Thus 
the next step is to consider what kinds of children were most 
affected by preschool. 
Methods and Results 

The possibility that preschool was differentially effective for 
different kinds of children was investigated first by determining 
whether the set of preschool-by-background crossproducts (interactions) 
would have a significant relationship to school outcomes when the set 
of backgroxmd variables was controlled.^ The background variables 
were: sex of child, ethnic background, family structure (father 
present or absent) , family size (number of siblings) , and maternal 
education. Standard regression analysis was employed. The 
interactions were represented by a set of multiplicative terms in 
the regression equation, formed by multiplying each background 



For a more detailed discussion, see J, Royce, 1979- 
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variable by the categorical preschool variable (preschool vs, control).*^ 

2 

The increment in R due to addition of these non-linear crossproduct 

2 

terms was then tested by the F_ statistic. 

2 

The results are shown in Table 26. The first column (K. ) 

A 

2 

shows the R for the set of linear terms (the background variables 

2 2 
listed above). The second column (R^^) indicates the total R for 

AB _ 

3 

the set of linear terms and the set of interactive terms (set B) • 

As Table 26 shows » the £ values range from .1921 to .6443. 

The set of interaction terms did not contribute significantly to the 

explained variation in school outcomes over and above that which 

4 

was explained by the linear background terms alone. Thus, we can 
conclude titst preschool apparently helped children regardless of 
their sex, ethnic background and family background. 



Some data sets did not have a complete set of interactions. 
Palmer's all-male project did not have a sex-by-preschool 
crossproduct. The all-black samples (Gray, Weikart, Palmer) did 
not have ethnicity-by-preschool crossproducts . Gordon did not 
have a crossproduct for family structure, 

2 2 

The F statistic is the ratio between the increment in R divided 

by the amoimt of residtial variance after both the numerator and 
denominator have been divided by the appropriate degrees of 
freedom. 

3 2 

The individual _F values were converted to z and then summed. This 

sum was compared to a chi-square table with degrees of freedom 
eqiial to the number of combined F's. The last column presents 
the combined significance levels. 

^ Becatise the set of background interactions was not significant, 
the results from each background interaction were not pooled. 
The F values for these interactions (preschool by mother's 
educational level, father presence, number of siblings, sex, and 
ethnic group) are shown in Table 27A. 
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Another set of regression analyses was prepared to test 

whether preschool helped only the brightest children. In this case, 

the linear terms were preschool attendance and initial IQ scores^ 

2 

and the crossproduct was preschool-by-initial IQ. Table 27 

indicates that the interaction of initial IQ and preschool 

attendance was not significant; £ values range from «32?6 to .8291. 

Only two individual projects show a £ value belrw .10. In Gray's 

group, treatment children with loHfiXL initial IQ scores were slightly 

siore likely to avoid special education assignment than were treatment 

3 

children with higher IQ scares (p « .069?). The other project was 
Weikart's group, where treatc^nt children with higher initial IQ 
scores were slightly less likely to be classified as underachievers 
compared to treatment children with lower initial IQ scores (p • .0731) 
Since Table 27 contains 17 p-values, one or two values around .06 
or .07 are almost exactly what would be expected by chance. 

The investigation was carried one step further by examining 
the number of positive versus the number of negative beta weights 
in order to determine whether there was a consistent pattern of 
children with initially low or high IQs benefitting more from 
preschool. No such paftem en^rged. Thus, we can safely conclude 
that there is no evidence that preschool differentially benefitted 



Iteasured prior to beginning preschocl. 

With only one crossproduct, the significance of the interaction 
was tested by testing the significance of the beta weight of the 
interaction. The beta weight was converted to a F ratio, as shown 
on Table 27. 

A negative regression coefficient indicates that children with 
lower initial IQs benefitted more from preschool. 
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the children who were already somewhat brighter. The same analyses 
seeking consistent patterns were performed for mother's education* 
father presence, number of siblings, sex, and ethnic background, 
with similar negative results (see Table 27A) . 

In sum, these results imply that policy-makers need not 
worry about selecting which ethnic groups or family configurations 
or levels of intelligence to serve. All lower- Income children can 
apparently benefit from preschool experience. 
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Table 26 



The Relationship Between School Outcomes and the Set of Treatment by Background 
C rossproducts (interactions) when Linear Terms are Partlalled Out 

^ ^ p pooled CiHQbined 



Data Set (n) 



AB 



(2 tailed) 



.2 



p (2 tailed) 



Special Education Placement 



Experimental 












Gordon (64) .0662 * 


.1118^ 


.941(3,55)° 


.427 






Gray (51) .2176 


.2274 


.130(4,41) 


.971 






Weikart (123) .1253 


.1978 


2.553(4,113) 


.043 






Total Experimental (238) 








4.737 d 


.1921 


Quasi'-Experimental 












Seller (53) .0920 


.1269 


.328(5,41) 


.893 






Levenstein (123) .0864 


.1239 


.950(5,111) 


.452 






Miller (106) .0568 


.0784 


.441(5,94) 


.819 






Total all data sets (520) 








5.373 


,4970 


Grade Retention 


Experimental 












Gordon (53) .0942 


.1559 


1.072(3,44) 


.371 






Gray (48) .1271 


.2560 


1.646(4,38) 


.183 






Palmer (219) .0567 


.0624 


.428(3,211) 


.733 






Welkart (97) .0448 


.0559 


.256(4,87) 


-906 






Total Experimental (417) 








2.707 


.6081 


Quasi- Experimental 












Seller (53) .2051 


.2347 


.317(5,41) 


.900 






Levenstein (107) .1213 


.1990 


1.843(5,95) 


.112 






Miller (101) .0397 


.0455 


.108(5,89) 


.990 






Total all data sets (678) 








5.249 


.6296 


Underachievement (Special Ed/Retention/Dropout) 


Experimental 












Gordon (64) .0486 


.0967 


.976(3,55) 


.411 






Gray (52) .1610 


.2736 


1.628(4.42) 


.185 






Palmer (219) .0567 


.0624 


.428(3,211) 


.733 






Welkart (123) .1127 


.1619 


1.658(4,113) 


.165 






Total Experimental (458) 








4.480 


.3449 


Quasi-Experimental 












Seller (56) .1771 


.2090 


.355(5M ) 


.876 






Levenstein (125) .0790 


.1172 


.97P(5,113) 


.435 






Miller (120) .0438 


.0574 


.312(5,108) 


.905 






Total all data sets (759) 








5.128 


.6443 


Note. Equation: ACH - MED + FP + SIBS 


+ SEX + ETH + 


PC + PCMED + 


PCFP + PCSIBS + PCSEX 


+ PCETH. Legend: PCMED 


■ preschool x mother's 


educational 


level; PCFP 


- pre- 



school X father present; PCSIBS - preschool x siblings; PCSEX » pre-- 
school X sex; PCETH ■ preschool x ethnicity; also see Table 12. 

step 1, linear terms only* 



R?. - total r2 <" linear terms and interactions. 
AS 

F « ratio between increment in divided by amount residual variance (after dividing 
numerator and denominator by appropriate degrees of freedom) t Numbers in 
parentheses indicate degrees of freedom. 

" x2; degrees of freedom ^ nunsber of pooled F's. 
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Table 27 

The Effect of Initial IQ Level on the Relationsh ip Between 
Early Education and School Outcomes 







PREIQ 




Signif . 




tooled £ 






X PC 




Level 


Pooled 


Data Set 


n 


Coeff . 


F 


(2 tailed) 


£ score 


(2 tailed) 






Special Ed 


Placement 








Approx. Experimental Design 




1.331^ 








Gordon 


43 


.018 a 


.2585 






Gray 


49 


-.012 


3.499 


.0693 






Veikart 


123 


.018 


2.386 


.1258 


.4874*^ 




Experimental Total 


215 








.6260 


Quasi-Experimental 














Seller 


65 


.002 


.273 


.6047 






Levenstein 


121 


.007 


.692 


.4082 






All Data Sets 










.9790 


.3276 



Grade Retention 



Approx. Experimental Design 



Gordon 


32 


-.021 


1.118 


.3034 


Gray 


46 


-.010 


.757 


.3919 


Palmer 


134 


-.004 


.441 


.5086 


Veikart 


97 


.006 


.400 


.5297 


Experimental Total 


309 








Quasi-Escperimental 










Seller 


65 


.00007 


.000 


1.0000 


Levenstein 


106 


.011 


1.968 


.1647 



All Data Sets 



-.9590 (.3376) 



-.2158 (.8291) 



Underacliievement (Special Ed/Retention/Dropout) 



Approx. Experimental Deslgi 


El 












Gordon 


43 


.008 


.187 


.6697 






Gray 


51 


-.010 


1.009 


.3228 






Palmer 


134 


-.004 


.441 


.5086 






Weikart 


123 


.023 


3.282 


.0731 






Experimental Total 


351 








.2843 


.7762 


Quas i- Exp er imen t a 1 








.6648 






Seller 


68 


.004 


.191 






Levenstein 


123 


.011 


1.480 


.2271 






All Data Sets 










.9021 


.3670 



Note. Eqvition: ACH - PC + IQPRE + PCIQPRE . Legend: PCIQPRE - preschool x initial 

IQ score. See Table 12 for legend. 
* Unstandardized regression coefficient for initial IQ x preschool interaction. 
Positive coefficient indicates benefit favors children with higher initial IQ score. 

^ F test for significance of interaction beta weight. Simultaneous (standard 
regression) method with interaction term added after all other variables. 

Pooled jB ■ Iz./Zk". 

Parentheses indicate negative pooled z_ score. That is, benefit favors children 
with lower initial IQ score. 
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Table 27A 



F Values for Beta. Weight of Interaction Terms 
(Crossproducts of Treatment and Background Characteristics) 



Data Set (n) 


PCMED 


PCFP 


PCSIB 


PCSEX 


PCETH 


Special Education Placement 


Experimental 












Gordon (64) 


.337 




- .790 


- .336 




Gray (51) 


.066 


.000 


- .263 


- .297 




Veikart (123) 


.021 


-6.799** 


-5.326* 


- .573 




Quasi-Experimental 












Seller (53) 


.068 


.045 


-1.45 


- .011 


- .261 


Levensteln (123) 


.000 


- .425 


.149 


3.042 


.121 


MUler (106) 


.772 


.124 


- .000 


- .007 


- .767 


No. of positive bnta tfelshts: 


^ 5 


2 


1 


1 


1 




Grade 


Retention 








Experimental 












Gordon (53) 


1.535 




- .005 


-1.044 




Gray (48) 


.194 


-2.684 


.051 


-3.267 




Palmer (219) 


.000 


1.068 


- .251 






Welkart (97) 


.042 


- .132 


.117 


.433 




Quasi-Experimental 












Seller (53) 


.109 


.005 


.038 


.060 


- .143 


Levensteln (107) 


3.065 


2.184 


1.781 


.033 


-8.024** 


Miller (101) 


.017 


- .188 


.083 


.007 


- .074 


No. of positive beta weights: 


3 


3 


5 


4 


0 


Underachlevement (Special Ed/Retention/Dropout) 


Experimental 












Gordon (54) 


.990 




- .326 


- .327 




Gray (52) 


.403 


-2.523 


- .040 


-3.667 




Palmer (219) 


.000 


1.068 


- .251 






Welkart (123) 


.143 


-5.248* 


-2.508 


- .027 




Quasl~Experlmental 












Seller (56) 


.106 


.134 


- .004 


.015 


- .284 


Levensteln (125) 


.009 


- .439 


.460 


1.742 


-1.938 


Miller (120) 


.464 


.104 


.004 


- .008 


- .706 


No. of positive betawc.'. 


5 


3 


2 


2 


0 



Note. Sign of F is sign of beta weight for interaction term. Positive sign 
indicates higher level of mother's education; father present; fewer 
siblings; male student and black ethnic group. 

Legend: PCMED - preschool x nrnther's education; PCFP - preschool x father 
presence; PCSIBS - preschool x number of siblings; PCSDC - 
preschool x sex; PCETH - preschool x ethnicity. 



■ These totals exclude beta weights of .000. 
* p - <-.05 
** p -<.01. 
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What Kinds of Programs Were Most Effective ? 
In considering differential effectiveness of preschool programs, 
the question arises: what kind s of programs were most effective? 
The answer to this question is especially important to policy-makers. 
And it is a question which has been difficult to answer. For example, 
two very recent early intervention programs report considerable 
success in raising the IQ scores of low-income Black infants (Garber 
& Heber, 1977) and under-nourished Colombian children (McKay, et al • , 
1978), but neither was able to stipulate what parts of the program 
were responsible for the gains. The preliminary report of the 
National Day Care Study (Abt, 1978) has been somewhat more 
successful; early results point to the importance of group size and 
teacher training in child-related fields as important influences on 
both classroom behavior and cognitive outcomes of participating 
children. 

Since some of the Consortium's principal investigators had 
built program variations into their original designs, we undertook 
analysis of the Consortium data in the hopes that it could shed 
some light on the Important question of program effectiveness. 
The reader should bear in mind, however, that this is a secondary 
analysis of data which were not, in many cases, originally designed 
to answer this particular question. Specifically, problems arose 
in choosing a common measure of program effectiveness and, 
consequently, in comparing programs across sites (e.g., comparing 
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Miller's programs to Karnes' programs), as will be detailed below. 
The current report should be regarded as one more sf**p in our 
continuing search for meaningful and valid ways of assessing the 
prograiQ effectiveness of the Consortium projects. 

Vopava and Royce (1978) addressed the question of what kinds 
of Consortium programs were most effective in detail.*^ The set of 
children within a project who received the same type of curriculum 
(e.g., Montessori, Bereiter-Engelmann, etc.) was the unit of 
analysis. There were 21 such subgroups^ Twenty-four 
program characteristics — such as age of child at entry, 
presence or absence of home visits, amount of teaching structure, 
etc. — were assessed, using reduction in special education 

2 

placements in later school years as the measure of effectiveness* 

Nine program characteristics were significantly related to 
3 

effectiveness. Five ot those program characteristics were 
highiy intercorrelated: age of entry, home visits, program goals 
for parents, parental involvement and number of children per adult. 
Together, they suggest that the most effective programs involve 
one instructor working with an infant or toddler and his/her parent 



See also Consortium (1977) for another, earlier effort. 

See the methods section of this chapter for a full desciiption 
of how this measure is derived. 

They i^ere: age of entry (r * -.6^4), program goals for parerts 
(r » •SS), home visits (r * .64), center-based program (r « --56), 
children per adult (r - -83), professional staff (r = -.50), 
parental involvement (r = .60), hours per year of program (r - .73), 
adult contact hours (r = -.53). 
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in the home. Because of the high intercorrelations, however, 
it was not possible to pinpoint the relative importance of the 
five variables in reducing later placements in special education* 

We have reviewed the above results in accordance with our 
general policy of reporting results reasonably oromptly but then 
challenging thetn by testing alternative hypotheses.^ In searching 
for the TOSt effective kinds of preschool programs » our work this 
year had the following aims: (1) to increase the power of the 
statistical analyses by reducing the number of program 
characteristics, primarily by combining those characteristics which 
were highly intercorrelated; and (2) to test the robustness of any 
positive findings. In brief preview of the findings, we have had 
to consider the results as inconcl^isive. Using the independent 
and dependent variables. described below, vje were unable to reject 
the null hypothesis that variations in program characteristics 
are unrelated to program effectiveness. 

Methods . For ail the analyses in this section, the unit 
of analysis was the subgroup within a project, defined as the 
set of children who received the same type of curricul ^ (epg., 



This policy served us well in reporting the findings on the 
overall effects of preschool on later school performance. 
Our early analyses I'ound positive effects (Consortium, 1977)* 
The findings then survived the numerous ch.^llenges documen'iied 
in this report, serving to increase our confidence in those 
findings. 
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Montessoriy DARCEE, etc.)- There were 21 such curriculutD subgroups 
across different projects, as shown in Table 28. 

The independent variables — program characteristics — for 
these analyses are shown in Table 29. These are based on ratings 
submitted by the principal investigators. Some were quite objective, 
such as the average age at which children entered the program* 
Others were more subjective, such as the importance of language 
goals. Earlier reports and papers from this research group 
(Consortium, 1977; Vopava & Royce, 1978) reported analyses on 
24 such program characteristics. We have since pruned this number 
down to 10. Some of the 24 variables were eliminated because they 
were conceptually redundant with variables left in, and others were 
eliminated because they correlated very highly with the remaining 
variables. This pruning process is described in more detail by 
Ypelaar (1978), 

For the dependent variable, the reduction in special education 

placements in the v^blic schools was used as the measure of program 

2 

effectiveness for these analyses. This reduction was defined as 
the percentage of experim^^ntal-group children not placed in special 
education classes, minus the comparable percentage for the control 
group from the same project. Analysis of co\;ariance was used to 



The individual child cannot be the unit of analysis, since a 
single exceptionally effective teacher, or some other single 
chance effect, might veil improve the performance of all the 
children in a group. Thus the children in a subgroup cannot be 
considered to be statistically independent of each other. 

Sinci: the Palmer project had no data on special education 
placements, it was not used in these analyses. 
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correct for any differences between ejcperiowntal and control groups 
on pretest IQ scores. Thus, in this section, the measure of 
program effectiveness is the proportion of a program's children not 
placed in special education, tninus the same proportion for a matched 
control group, after adjusting for any pretest IQ differences 
between the program and control groups. The values found in this 
way are shown in Tcble 28.^ 

Particular difficulties arose in the analysis of three projects 
using this measure of effectiveness. Karnes had no control groups, 
so the procedure could not be applied to her data. Instead we 
compared the proportions in each subgroup to the proportions in the 
five Karnes subgroups combined. This would tend to make the Karnes 
subgroups look less effective than those of other projects since 
presumably all her program subgroups had fewer children placed in 
special educatxon than a control group would have. Miller's control 
group came from a higher income level than her experimental groups 
and had significantly higher percentages of white and father- 
present families. As a result, the measures of program effectiveness 
for her data contain a strong conservative bias. Unfortunately, 



We did not adjust the subgroups from Gordon's project for pretest 
IQ since most of the children in his project had not been 
administered an IQ test before they began the program. For the 
few children who had been pretested, control children had a 
higher mean pretest IQ than program children; thus the bias 
appears to be in the conservative direction. Miller's sub- 
groups were not adjusted for pretest IQ since the first IQ test 
she administered was 6-8 weeks after the program had started.. 



a conservative bias in the analysis of overall program effectiveness 
can introduce a liberal bias in the present analysis. For instance, 
all of Miller's programs used older children; thus, underestimating 
the effectiveness of Miller^s programs will make programs for young 
children look good in comparison to programs for older children, 
thereby introducing a spurious correlation between age and program 
effectiveness. Seller's data was similarly over-conservative 
because the Philadelphia school system placed almost no children into 
special education* Thus, even if Seller's project had been totally 
effective in eliminating special education placements, Seller's 
project would have appeared to be below average in effectiveness by 
this measure of effectiveness. We considered other measures of 
effectiveness, such as the ratio between program-group special 
education placements and control-'group special education placements, 
but all were rejected for technical reasons, even though they might 
have solved this particular problem for Seller's data.^ 

The variable of parental involvement concretely illustrates 
this problem. As noted above, the Vopava and Royce (1978) analysis 
suggested that five intercorrelated variables caused effective 
outcomes. In the current analyses, four of those variables — goals 
for parents, home visits^ parental involvement, and children per 
adult — have been combined with child group size into a single 
variable, labelled "Parental Involvement." Looking at the 



Two different approaches, to be described later, were used to 
circumvent these difficulties with the Karnes, Miller, and Seller data 
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subgroups' ratings on this variable, however, it turned out that the 

Karnes, Miller, and Seller projects accounted for all the subgroups 

with low or moderate parental involvement* Since all these 

programs had over-conservative estimates of effectiveness, analysis 

would result in a spurious correlation between parental involvement 

and program effectiveness* If the three projects were deleted, 

th^re would be no variance on parental involvement — all remaining 

programs had high parental involvement. We are thus particularly 

unable to assess the importance of parental involvement in the 

preschool program* 

Because our sample consisted of only 21 observations (subgroups), 

and because we cannot be sure of normal distributions, the jackknife 

technique was used for estimates and significance tests. This 

technique is powerful for smp.ll non-normal samples. In the 

jackknife technique^ one observation, or a group f observations, 

is removed from the sample one at a time and the statistic of 

interest is computed. Then thf* observation Is replaced, another 

observation is removed^ and the statistic is recomputed. This 

procedure is repeated until all observations have been removed 

once. The statistics computed in this way are used to compute 

both an estimate of the statistic of interest and a standard error 

of that estimate. The ratio of the estimate to its standard error 

2 

Can then be tested as a t statistic in the usual way. The 



For a fuller description of the technique, see Hosteller and 
Tukey (1977). 

See Ypelaar (1978) for more details. 
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jackknife technique is so named because it is so versatile — 
significance tests can be performed on virtually any statistic by 
this technique. In addition, since observations are systematically 
deleted, it serves as a test of robustness. 
Results 

Four different jackknife analyses were performed; only the 
third and fourth will be reported in detail here. The first two 



jackknife analyses led to the discovery of the problems with the 
Seller, Karnes, and Miller projects detailed above. 

In the third jackknife analysis, we excluded the three 
problematic projects entirely from the analysis and then removed 
the remaining subgroups (N 10) one by one. Columns 1 and 2 of 
Table 30 show the results. One variable — preservlce training of 
teachers — was significantly related to effectiveness. An 
examination of the raw data, however, indicated that this finding 
was due to only one project: VJeikart."^ A finding based on only 
one project is inconclusive because, since the location of the 
project and the project curricula were confounded, it might be? an 
artifact of the policies of that particular school district. 

In the fourth jackknife analysis we looked only at intra-proj ec t 
dii^f erences* Thir procedure was followed because it was virtually 



Staff training implies an existing curriculum in which stafr are 
trained. For the P^rry Preschool the process might better be 
characterized as program development with input from both 
classroom and non-f.lassroc^m staff throughout the year. 
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impossible to compare the average effectiveness of the Karnes « 
Miller, or Beller programs to the average effectiveness of the 
other preschool programs, as explained earlier. Imagine that in 
every project which included separate programs for young children 
and older children, the programs for younger children had shovm 
up as more effective. This imaginary result would be extremely 
interesting and would not be hampered by the difficulties of 
comparing effectiveness across projects. To search for results 
like this, we examined only intra-project differences in 
effectiveness between programs by adjusting the average 
effectiveness measure for each project to zero. Thus a negative 
effectiveness by this measure would mean only that a program 
was less effective than the average of the programs studied by 
that particular investigator. As Table 30, columns three and 
four show, this jackknife analysis found no significant 
correlations between program effectiveness and program 
characteristics. Since there were no positive findings in this 
analysis, ws have to conclude that no one type of program can 
confidently be identified as more effective than any other. 

In review, we have looked at the data in three different 
ways — once in Consortium (1977), once by Vopava and Royce (1978), 
and once again in this chapter. However, all of these analyses 
have difficulties. Our first analysis (Consortium, 1977) 
suffered from using the child rather than the subgroup as the 
unit of analysis, while the second (Vopava and Royce, 1978) 

r - 
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underestitnated the difficulties involved in using the Miller 

and Seller data on reductions in special education placement. 

The present analyses suffer frons several difficulties outlined 

in the next paragraph* 

How can we interpret the current results? We roust emphasize 

that we have not shown that there are no differences in program 

effectiveness. For example, parental involvement may play a 
I* 

crucial role in preschool education, but our data cannot address 
that issue. One reason for t^e lack of findings is that the 
statistical technique we used is very conservative, leading to a 
loss of power. When we have so few observations to begin with, 
this loss of nower can be ill-afforded. A second reason is that 
the dependent variable used here (frequency of placement in 
special education) may not be the most sensitive variable for 
differentiating among different programs at different sites; 
frequency of special education placements varies randomly from 
city to city and random error lowers the power of the analysis. 
Third, all of the Consortium preschool programs were exceptionally 
well-run programs. It is more difficult to find differences among 
programs which were uniformly well-run than among programs which 
were not. Fourth, we must remember the general statistical 
principle that when the null hypothesis fails to be rejected, the 
null hypothesis is not therefore proved. 

The Consortium is currently platining to reexamine its data 
in still other ways which may yield different results. We 
plan to examine program characteristics in depth in three of the 
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projects which had planned curriculum variations (Karnes, Miller, 
Weikart) . We plan to use achievement test scores as a dependent 
variable. We will attempt to use alternative methods of analysis 
which may be more powerful than the statistical analyses reported 
here. In the meantime, we would caution against putting too much 
reliance on either the findings reported earlier or the lack of 
findings reported here. Instead, we note that the data suggest the 
real need for new experiments specifically designed to separate 
and measure the effects of these important program variables. 
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Table 28 

Subgroups and Sf fectiveness Score 
in Reducing Special Ed Placements 



Adjusted 

Project Subgroup Difference 



Beller T^* 


Nursery School 


0.007 


Gordon , , 
1.3.4 


One year home visits; 2nd year 
home visits and home learning 
center 


0.234 


T 

2,5,6 


One or two years of home visits 
only 


0. 371 


^7 


One year of home visits and home 
learning center 


0.332 


Gray Early Training 
Project 


Two year program 


0.250 




One year program 


0.266 


Karnes T^ 


Traditional 


0.002 


^2 


BereiLer-Engelmann 


-0.139 


^3 


GOAL 


0.077 


^6 


Montessori 


0.159 


^7 


Community Integrated 


-0.101 


Levenstetn T, 

1 9 Id 


One year program 


0.257 


T 

J* 7 fi 


Two year program 


0.203 


T 

14,15 


One full year and one short 
year program 


0.383 


Miller 


DARCEE 


0.025 


^1 


DARCEE with home visits 


-0.250 




Bereiter Engelmann 


-0.106 


^3 


Montessori 


-0.051 


^4 


Traditional 


0.000 


Weikart /Perry 
Preschool T^ 


Two years 


0.129 


T 
^2 


One year 


0.124 



Source: Vopava and Royce (1978), p. 14. 



* T refers to treatiMnt group. Each number indicates a different 
program approach within the project as a whole. 
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Table 29 

Reduced Set of Program Variables Included in the Analysis 

Ace of child at entry 
Length of program in years 

Mentha per year that program operated 

1 

Parental Involvement 
Center-based program 

2 

Professional vs. paraprofessional Staff 

Freservice training for staff 

Language goals for children 

Amount of teaching structure 

3 

Hours per year of program 



^ This represents a new variable, created by combining the following 
five variables: (1) goals for parents; (2) parental involvement; 
(3) home visits; (4) children/adult; (5) child group size. These 
five variables were so highly intercorrelated as to represent a 
single variable. See Ypelaar (1978) 

^ This represents a new variable, created by combining the following 
three dichotomous variables: (1) use of professional staff; (2) use 
of paraprofessional staff; (3) use of volunteer staff. The new 
variable was coded dichotomously , representing the highest level 
of professionalism attained (professional vs. paraprofessional). 
See Ypelaar (1978) 

^ Transformed to log (hours) to make the variable more normally 
distributed for correlational analysis. See Ypelaar (1978) 
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Table 30 



Jacknlfed Estimates of the Effectiveness Correlation and 
Associated Probability Level for Each Program Variable 



Between-Projects Analysis 



Within^Projects Analysis 



Subgroup 
r*+ 



Age -.234 

Years of -.336 
Program 

Month/Y^ar . 269 

Parental + 
Involvement 

Center -.469 

Paraprofes- -.277 
slonal vs. 
Professional 
Staff 

Preservice .806 
Training 

Language Goals -.059 

.256 



Teaching 
Structure 



LN 



-.669 



Corrected 
Signif . 
Level 



.01 



Subgroup 
r* 



.022 
-.135 

t 

.213 

.023 
.154 



-.255 
-.082 

-.084 



Cor rec t ed 
Signif . 
Level 



(Hours/yr, ) 



Note . All significance levels are two-tailed, 
larger than .05. 

* Refers to jackknifed r. 

^ Without Seller, Karnes and Miller projects. 

* No variability. 



( — ) indicates probTbility 
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Matching Children to Programs 
Th« failure to find evidence in our data of differential program 
•ffecti ^as wae due in some part to problems with control groups 
in the Seller, Karnes, and Miller projects. Hence we were forced to 
eliminate these projects from the analysis or to perform within- 
project analyses only. However, another question of interest 
concerning program characteristics arises which may be answered 
without including control groups in the analysis. In the groups 
of treatment children, did sousb kinds of children respond s«jre 
to certain programs than to others? For example, did children 
from large families benefit more from programs with high structure 
than did children from small families? We can answer these questions 
by examining statistical interactions. The question just posed, for 
exan^sle, can be examined by studying the interaction between family 
size and program structure. If such effects were found to exist, 
it would be possible to make specific recommendations, in matching 
children to programs. 
Methods 

To assess the presence or absence of interaction effects, 
regression analyses using second order terms were performed. The 
wasurea of effectiveness of programs ~ the dependent variables — 
vara placement in special education and retention in grade. 
They ware chosen because earlier analyses had indicated that 
praschool attendance affected them and because they represent 

1^1 
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iaqiortant, fiscally relevant outcomes for individual children. 

The program variables used included eight of the ten variables 

which were least collinear: age of the subjects 

at onset of intervention, the length of intervention, the 

nm&er of months of intervention, the nimber of hours per year of 

intarvention, tl» level of parental involvement, the presence or 

absence of language goals, preservice training for program teachers, 

f 

and the degree of structure in the teaching methods. These 
variables represent only a subset, although a select subset, of all 
possible program characteristics. 

The child characteristics included the child's pretest IQ score 
and birth order, level of mother's education, family size (number of 
siblings), family structure (father presence or absence) and the 
initial hopes of the mother for the educational attainment of the 
child. The latter variable was coded from the intake interview 
before preschool. 

All treatment children from the following projects were inc''"ded 
in the analyses: Seller, Gordon, Gray, Karnes, Levensteln, Miller, 
Palmer, Welkart. 

The regression analysis proceeded as follows. First, all linear 
terms (i.e. the eight program variables and the six child 
characteristics) were adjusted to means of zero. Then 8 x 6 or 48 
Interaction terns were created by multiplying each of the program 
variables by each of the child variables. To avoid excessive nuaiers 
of regression terms in any one regression equation, we studied only 
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the eight interaction ferms pertaining to a single child 
characteristic at any one tine (that is. in any one regression). A 
forced-ord(^r regression was performed in two steps, entering first 
the eight program variables and the one selected child characteristic, 
and second entering the eight interaction terms pertaining to that 
characteristic. The increase in obtained in this second step 
(in other words, the proportion of variance due to interaction) was 
then tested for significance. This procedure was repeated for each 
child characteristic variable. This whole process was perforrived for 
two dependent variables: retention in grade, and assignment to 
special education. Since we were studying here the relative 
effectiveness of various treatments, only children who had 
attended infant or preschool programs were used in these analyses. 
Results 

Table 31 shows the results of the analyses with assignment to 
special education as the measure of program effectiveness.^ Clearly, 
thsre were no significant interactions involving the child 
characteristics and program characteristics. While pretest IQ 
score and maternal education approach significance, they would not 
survive the procedure of correcting for multiple comparisons . 
Thus we cannot even consider then aa trends, Similarly, Table 32 



^ The numbers reported represent the F values and £ values associated 
with the increase in r2 after inclusion of the interaction terms on 
the second step of the regression. 

2 If any of the variables had proven significant, the next step would 
be to examine individual program characteristics to determine which 
were moat effective. 
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reveals no significant interaction effects when retention in grade 
is the measure of effectiveness. 

In sum, there appear to be no systematic benefits derived by 
matching certain kinds of children to certain kinds of programs, at 
least insofar as we have been able to measure using molar measures 
of program effectiveness. This result is discouraging in the sense 
that we can provide no specific guidance to policy-makers who design 
programs. It is important to point out, however, tl^t these programs 
were well-operated. In that sense, we may say that infant and 
preschool programs, if they are well-run, benefit all kinds of 
lower- income children. 



Table 31 

2 

F Values and p Values for Incremental R of 
Interaction Tems^sing Special Ed as Dependent Variable 



Child Characteristic 


F 






Pretest IQ^ 


2.0651 


.0747 


128 


Mother^ s Education 


1.68842 


.0996 


394 


Father Presence 


.81653 


.5884 


377 


Birth Order 


.84316 


.5650 


418 


Number of Siblings 


.61224 


.7677 


418 


Mother* s Pre- intervention 


2.117 


.1298 


63 



nopcs for Child Kducation 



a This table indicates the extent to which the interaction terms 
significantly increased our ability to predict the dependent 
variables . 

^ Size of sample varies because sor subjects had missing data on 
sose characteristics. 

c Only those projects with Stanford-Blnet IQ scores were included 
in the analyses: Beller, Gray, and Weikart. 
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Table 32 

F Values and p Values for Incremental R of 
Interaction Terms^ Using Retention Dependent Variable 



Child Characteristic 


F 


£ 




Pretest IQ^ 


.6769 


.6915 


208 


Mother's Education 


.63A83 


.7486 


519 


Father Presence 


.60428 


.7745 


507 


Birth Order 


1.13953 


.3348 


532 


Nuober of Siblings 


1.3216A 


.2299 


418 


Mother's Pre- intervention 


1.48609 


.2371 


51 



Hopes for Child Education 



This table indicates the extent to which the interaction terms 
significantly increased our ability to predict the dependent 
variables. 

Size of sample varies because some subjects had missing data on 
some characteristics. 

c 

Only those projects with Stanford-Binet IQ scores were included 
in the analyses: Seller, Gray, Palmer, and Weikart. 
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Summary of Differential Effects 
The first section ("Which Children Benefit Most on WISC-R 
Test Scores?") reported no differential gains on later intelligence 
tests for boys as opposed to girls or for children whose mothers 
had tnore vs. less education. 

The hypothesis tested in the section entitled. "Which Children 
Benefit Most on School Performance?", was: the effect.^ of preschool 
on later school outcome are due to the fact that preschool benefits 
some kinds of children more than others. The hypothesis was not 
confirmed. There was no evidence in these data that the preschool 
experience helped boys more or less than girls, white children more 
or less than Blacks, children with higher initial IQ scores more or 
less than those with lower initial IQ scores, children from two- 
parent families more or less than those from single-parent families, 
or children with fewer siblings more or less than children with 
many siblings. 

In the section entitled, "What Kinds of Programs Were Most 
Effective?", we attempted to answer the question: what kinds of 
preschool programs were most effective? Ten different variables 
were used (as independent variables) to characterize the programs. 
The measure of effectiveness was the reduction in special education 
placements associated with preschool attendance. In general, we 
were unable to show that some program characteristics were superior 
to others in reducing; placements in special education. 
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In the secwion entitled, "Matching Childreji to Programs'*, we 
atteaqpted to determine whether the various prograaj characteristics 
helped sone kinds of children loore than others. Avoiding 
assignraent to special education classes and retention in grade were 
used as assures of benefits to children. Once again, there was no 
evidence that some of the children who attended preschool derived 
more benefit from certain kinds of programs than others. 

Taken together, all four results suggest that all low- income 
children can benefit from attending hij^h quality programs. 
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THE EFFECTS OF FAMILY CHARACTERISTICS ON 
SCHOOL OUTCOMES FOR LOW- INCOME CHILDREN 

Predicting School Outcomes 
Throughout this report we have concentrated our efforts on 
comparing children vith preschool experience to children who lacked 
that experience. However, these "treatment" and "control" children 
were originally chosen because they represented a population at 
risk for school failure: low-income, primarily Black children. 
The Consortium data bank represents a rich source of data concerning 
this population, containing background information. IQ scores and 
school outcome Pleasures for more than 3,000 children over a period 
of many years. In order to provide a general context for the 
treatment/control differences reported throughout this report, we 
partialled out the effects due to preschool and investigated the 
children's school performances in light of a number of characteristics 
measured prior to enrollment in preschool. In effect, we attempted 
to assess how well these measures predicted the later school 
performance of this sample of low-income children. Included in the 
analyses as predictors were family structure (father present vs. 
absent), number of siblings, mother's level of education, child's 
sex, and child's initial IQ scores and IQ at age 6. 
Methods 

As in earlier analyses, the variables used to assess school 
perforaance were assignment to special education classes, retention 
in grade, and underachievement (a coiiq)08ite variable consisting of 
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«peci«l «duc»tion placement and/or retention in grade and/or 
dropping out of school). Regression analysis was waployed to allow 
simultaneous coniiideration of the effects of the various child 
characteristics and family background variables while partialling 
out the effects of attending preschool. 

Results 

* The first such analysis included the following independent 

varlablas: child's sex, ethnic background, IQ score at age 6, 

family structure (father present vs. absent), family size (nuaber 

of siblings) and laother's level of education. We tested the 

hypothesis that mother's educational level would predict later 

school outcomes when the other background variables, preschool 

attendance, and IQ score at age 6 were controlled. As Table 33 

shows, there appears to be no such effect for assignment to special 

education (p » .4239. N - 557) or retention in grade (p - .5077. 

N • 678). For the composite underachievement variable, results 

are marginally significant (p - .0673, N » 774) when pooled across 
all projects. 

The analyses were repeated with the difference that IQ score 
at age 6 was not partialled out, and a somewhat different picture 
eaerged. As shown in Table 34, mother's educational level 
predicted all three school performance measures: assignment to 
special education (pooled p - .0233, N - 588), grade retention 
(pooled p ■ ,0215, N • 723), and underachievement (pooled p » 
.0003, N - 820). The findings were not robust for either special 

2oo 
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eduction plac«ient or reteution in grade. For underachievefflent . 
however, the reeults remained significant (p - .020) even when the 
two data seta with the strongest findings (Seller and Weikart) were 
deleted. 

In brief, level of xaatemal education strongly and robustly 
predicted children's underachieveaent when effects of other 
background characteristics and effects of preschool attendance were 
partiallcd out. The results were significant but not robust for 
the school performance measures of assignoent to special education 
and retention in grade. However, when the effects of the child's 
IQ score at age 6 on later school performance were partialled out . 
maternal education was not related to later school performance. 

How well did the other background variables predict later 
□chool performance? Kegression analysis was again employed with 
the set of independent variables of sex, ethnic background, family 
structure (father presence) and family size and partiallin: out the 
effects of maternal education and preschool attendance. As Table 35 
•hows, the set of independent variables was not associated with 
any of the school outcome measures. Apparently, then, only 
maternal education, of all the background variables gathere.^ before 
preschool programs commenced, significantly predicted children's 
later school performance for this sample of children (and only 
whan its effect on IQ score at age 6 was not partialled out of the 
equation) . 
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Table 33 



The Effect of Mother *s Education on School Outcomes when Preschool Attendance , 
Other Background Variables, and IQ at Age 6 Are Controlled 



Data Set 



Mother's 
Educ. 
Cneff . 



£ 

(2 tailed) 



Pooled 
z score 



Mean £ 
(2 tailed) 



Special Ed Flaceaent 



Gordon 


62 


-.0260 a 


.725 b 


(.4003): 


Gray 


50 


.0213 


1.760 


.1941 


Veikart 


120 


.0249 


2.346 


.1292 


Seller 


50 


- .0189 


.679 


(.4173) 


Levenstein 


116 


-.0263 


1.964 


(.1649) 


Killer 


106 


.0378 


3.088 


.0827 


Ki^mes 


53 


.0262 


.377 


.5444 


All Data Sets 


557 









.7997*1 



.4239 



Grade Retention 



Gordon 


51 


-.0468 


1.746 


(.1956) 




Gray 


46 


.0264 


.843 


o3671 




Palmer 


195 


.0321 


3.054 


.0826 




Veikart 


94 


-.0056 


.116 


(.7350) 




Seller 


50 


.0723 


3.207 


.0822 




Levenstein 


101 


-.0106 


.360 


(.5510) 




Miller 


101 


-.0082 


.337 


(.5640) 




Karnes 


40 


.0123 


.095 


.7616 




All Data Sets 


678 






.6624 


.5077 


Underachieveiaent (Sp^ial Ed/Retention/Dropout) 


Gordon 


62 


-.0415 


1.530 


(.2234) 




Gray 


50 


.0315 


1.635 


.2104 




Palmer 


195 


.0321 


3.054 


.0826 




Weikart 


120 


.0175 


.970 


.3278 




Seller 


53 


.0656 


2.735 


.1069 




Levenstein 


118 


-.0226 


1.125 


(.2922) 




Miller 


120 


,0291 


2.110 


.1500 




Karnes 


56 


.0181 


.187 


.6689 




All Data Sets 


774 






1.8298 


.0673 



Note. Equation: ACH - IQ6 + PC + FP + SIBS + SEX + ETH + MED. For legend, see 
Table 12. 

* Unstandardized regression coefficient for mother's educational level. 

^ F test for significance of mother's education coefficient, 
c 

Figures in parentheses are in reverse direction. 

d 



Pooled z - Ez^ / 
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Table 34 



The F.ff ^ct of MotherVc Education School Outcomes when Preschoo l 
^'f!!:.l.o .n. n«-h.r Backgrnnnd Variables Are Controlled 



Data Set 



Mother's 
Educ. 
Coeff . 



2_ Pooled 
(2 tailed) z score 



Mtan 2. 
(2 tailed) 



Gordon 64 

Gray 51 

Weikart 123 

Seller 53 

Levenstein 123 

Miller 106 

Karnes 58 

All Data Sets 578 



Special Ed Placement 


.OOia 


.002» 


(.9647) c 


.024 


2.004 


.1660 


.043 


6.720 


.0109 


.006 


.069 


(.7950) 


.019 


.986 


(.3238) 


.043 


3.863 


.0527 


.056 


2.103 


.1549 



2.2677<J 



.0233 



Grade Retention 



Gordon 


53 


-.015 


Gray 


48 


.038 


Paloer 


219 


.037 


Weikart 


97 


.001 


Beller 


53 


.108 


Levenstein 


107 


-.004 


Miller 


101 


-.004 


Karnes 

All Data Sets 


45 
723 


.058 



.141 
1.650 
4.108 

.002 
6.748 

.067 

.084 
2.785 



(.7104) 
.2085 
.0442 
.9645 
.0130 

(.7968) 
(.7732) 

.1052 



2^2988 

Underachieveoent (Special Ed/Retention/Dropout) 



.0215 



Gordon 64 

Gray 52 

Palmer 219 

Weikart 123 

Beller 56 

Levenstein 125 

Miller 120 

Karnes 61 

All Data Sets 820_ 



.001 


.000 




.041 


2.479 


.1241 


.037 


4.108 


.0442 


.040 


4.693 


.0327 


.110 


6.764 


.0127 


.014 


.452 


(.5036) 


.034 


2.894 


.0924 


.043 


1.287 


.2636 



3.6458 



.0003 



Ifote . Equation; AGH - FP + SIBS + SEX + ETH + PC + MED. For legend, see Table 12, 
•Unatandardised regression coefficient for iwjther's educational level. 
^ F test for significance of mother's education coefficient. 
^ Figures in parentheses are in reverse direction. 
Pooled z ' Zz^/{^, 
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Table 35 



The Effect of Other Background Variables on School Outcomes, When 
Mother's Education and Preschool Attendance Are Controlled 



Data Set 



R 



AB 



(2 tailed) 



Poojed 
z 



Pooled 2, 
(2 tailed) 



Special Ed Placeaent 



Gordon 64 

Gray 51 

Veikart 123 

Ballar 53 

Levenstein 123 

Miller 106 

Karnes 58 

All Data Sets 578 



.0221 a 


.0662'» 


.913 


(3.58)C 


.4404 


.2012 


.2176 


.314 


(3.45) 


.8149 


.0923 


.1253 


1.471 


(3,117) 


.2260 


.0017 


.0920 


1.144 


(4,46) 


.3480 


.0721 


.0864 


.454 


(4,116) 


.7694 


.0432 


.0568 


.357 


(4,99) 


.8387 


.0099 


.0803 


.995 


(4,52) 


.4186 



3.7773*^ 



.8050 



Grade Retention 



Gordon 

Gray 

Falser 

Weikart 

Seller 

Levenstein 

Miller 

Karnes 

All Data Sets 



Gordon 

Gray 

Palmer 

Weikart 

Seller 

Levenstein 

Miller 

Kamcs 

All Data Sets 



53 
48 

219 
97 
53 

107 

101 
45 

723 



.0037 


.0942 


1.565 


(3,47) 


.2106 


.0702 


.1271 


.913 


(3,42) 


.4431 


.0537 


.0567 


.340 


(2,214) 


.7119 


.0355 


.0448 


.295 


(3.91) 


.8287 


.1617 


.2051 


.628 


(4,46) 


.6450 


.0098 


.1213 


3.172 


(4,100) 


.0169 


.0170 


.0397 


.556 


(4,94) 


.6955 


.0346 


.0976 


.681 


(4,39) 


.6095 



8.6830 



.3697 



Underachieveaent (Special Ed/Retention/Dropout) 



64 


.0092 


.0486 


.801 


(3.58) 


.4986 


52 


.0987 


.1610 


1.139 


(3,46) 


.3435 


219 


.0537 


.0567 


.340 


(2,214) 


.7119 


123 


.0951 


.1127 


.774 


(3,117) 


.5110 


56 


.1479 


.1771 


.435 


(4,49) 


.7829 


125 


.0340 


.0790 


1.441 


(4,118) 
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SIBS + 


SEX + ETH. For 



5.1009 



:7467 



Note. 



Equation: 
Table 12. 



For legend, see 



* R^A ■ first step (MED and PC only) stepwise regression 
0 total R2 

c F • ratio between increaent in r2 divided by amount of residual variance (after 

dividing numerator and denominator by appropriate degrees of freedom). Numbers 
in parentheses Indicate degrees of freedom. 

d 2 7 

siz*" - x^; degrees of freedom - ntmiber of pooled F's. 
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REVIEW OF THE DETERMINANTS OF SPECIAL EDUCATION PLACEMENTS 

We «re now in a position to integrate some of our findings and 
attwapt to pinpoint the relative influence of the preschool 
experience on the development of this sample of lower-income 
children. We should point out that the discussion which follows 
le based on longitudinal data, that is, information about each 
child at several specific times in his/her life span.^ The details 
of family structure and size, maternal education, and initial 
IQ score were collected before the treatment children were enrolled 
in the preschool programs. These variables provide a picture, 
albeit limited, of the child's circumstances before experiencing 
intervention. The age at which the children began attending the 
programs is known. Moat subjects were given a posttest IQ test when 
they were b years old.^ at approximately the age when most children 
enter first grade. School records for the intervening 3 to 13 years 
provide information about the child's school performance up to the 
time of the 1976-77 follow-up. 

Yi^r^ 1 represents a diagram of the relationships between 
early background measures, preschool attendance. IQ score at age 6. 



^ Readers aore accuston«d to research utilizing cross-sectional data 
might iKsnder why we did not make use of the age differences among 
the 2.000 odd subjects to examine relationships among variables in 
wore detail. This procedure was deemed impractical because age of 
the children is Inextricably confounded with project. That is, 

. Gordon's children were aged 9 and Gray's ct^ldren aged 19 follow- 
up. Further»ore. there were cohort differences, with some children 
Staring preschool at the height of the War on Poverty and others 
Pterins as the Nixon Administration began dismantling many programs. 

2 10 scores at 6 years old were Stanford-Binet in all cases except PPVT 
icoJ« Slri uaenor Levenstein's sample. Palmer's children took the 
Stanford-Blnet at age 5. 

2&r, 



Figtnre 



AssiCTiment to Special Education Classes; Diagram Showing Network of Variables 
Suggested by Data, Significant Paths Only 
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amd later school outcome, in this case assignment to regular vs. 
special education classes. A time line has been drawn in to indicate 
the child's age at each measureiaent period. Each of the links 
pictured in the diagram represents an hypothesis test reported in the 
body of this report or in Royce (1979) . Let us use this diagram to 
guide us through a discussion of the impact of preschool on low- 
income children. 

On the far left are the variables measured before children 
enrolled in preschool. These are our most direct indicators of the 
early status of the children's background and their intellectual 
potential. Although not pictured in Figure 1, family background 
measures were related to the child's early XQ score, consonant with 
other research. Children from two-parent homes with fewer siblings 
and with mothers who completed more years of school were more likely 
to score high on IQ tests administered at age 3 or 4. Limited and 
controversial though they may be. IQ test scores do provide a measure 
of cognitive ability and, furthermore, are predictive of later school 
performance. Thus, the relationship of background variables to early 
IQ scores indicates that even within a lower- income group, some 
children started out "ahead" of others. 

Many of these children then participated in preschool programs 
of various kinds. The next time we assessed them as a group was at 
age 6, on the threshold of the first grade. Again, the measure of 



^ The relationship between mother's education and pretest ^Q^^ 
number of siblings and pretest IQ were reported in Murray (1977). 
Por the relationship between father presence vs. absence and pretest 
IQ, the correlation matrices were scrutinized. _r's varied from 
-.09 to .24 across eight projects. 

2f« 
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cognitive ability was an IQ test score • The reader will note the 
arrows connecting the background variables with IQ score at 6. These 
arrows indicate that in one sense the picture is the same as it was 
before; naiaely, children from two-parent families with few siblings 
and with more educated mothers scored higher on this measure of 
cognitive ability.'^ Notice, however, that the preschool attendance 
variable also connects with the IQ-at-age-6 variable* In other 
words, preschool became a new factor in these children's lives. 
Attending preschool also predicted a higher IQ score at age 6. 
Home background and preschool attendance were both important 
influences. If the effects of preschool were partialled out, the 
background variables still predicted higher IQ scores at age 6. 
And, vice-versa, if the effects of the background variables were 
partialled out, preschool attendance still predicted higher IQ 
scores. 

We next assessed the group of children in the 1976-77 follow-up 
study. They ranged from 9 to 19 years old and either had 
completed their school careers or were enrolled in grades three 
through twelve (or, in some cases, had dropped out of school). This 
time the dependent measure of interest was assignment to regular 
vs. special education classes- What is the relationship between 

^ This is true even after the effects of initial IQ scores on IQ 
scores at age 6 was partialled out. For five data sets with 
pretest IQ, the pooled £ values predicting IQ at 6 were .0001, 
.024, .025, .061 for mother's education, father present, number 
of siblings, and sex respectively. For the seven projects, the 
pooled £ values predicting IQ at 6 were .001, .018, .017, .750 
for mother's education, father present, number of siblings, and 
Hcx respectively. 
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the children's early background, preschool attendance, and their 
later school careers (i.e., avoiding placement in special education 
classes)?^ Now the picture is quite different. Not surprisingly, 
children's IQ scores at age 6 strongly predicted their school 
performance. In addition, preschool attendance predicted avoiding 
placement in special education, even if the effect of preschool on IQ 
score at age 6 was partialled out. The home background variables have 
dropped out of the picture, however. There was a relationship 
between mother's education and child's later school performance, but 
it disappeared when the effects of IQ at age 6 were partialled out. 
Furthermore, we have additional information about preschool 
attendance and family background that is not, for simplicity's 
sake, drawn into the diagram. We know that preschool helped all 
types of low-income children avoid placement in special education, 
regardless of family structure, family size, maternal education, 
sex of child, ethnic background, or initial IQ score of the child. 
Therefore, it seems safe to say that by school age, IQ scores 
at age 6 and preschool attendance importantly affected later school 
performance, as measured by children's placement in regular vs. 
. special education classrooms. 

These are striking findings and worthy of careful consideration. 
But many questions remain to be answered. The reader will recall, 
for exMple, that the effects of preschool attendance on retention 



erJc 



^ At this point we have only analyzed whether children 

bum assigned to special education classes (or retained in grade) . 
W« olan furthar analyses to ascertain wh«i children were so 
usigned or retained. Preliminary scrutiny of these data lead us 
to believe that results will not be substantially different. 
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in grade were not so large and that preschool attendance di'.d not 
predict later retention in grade independently of its effect on IQ 
score at age 6. We have some reason to believe that the retention- 
in-grtde variable is a weak one, but it may be that preschool just 
does not have the same impact on this variable. If that were so, 
why should it be the case? 

Purthenaore, we have only scratched the surface with our 
measures; there is a plethora of unmeasured intervening variables 
in need of investigation in order to clarify the process by which 
preschool exerted its impact. By partialling out the effect of 
preschool on IQ score at age 6, we essentially found that preschool 
affected children in ways that were relevant to school performance 
but not related to cognitive skills and abilities. Perhaps children's 
achievement motivation, values, aspirations, or coping styles were 
influenced. We reported limited evidence that this was so earlier in 
this report. Perhaps children's classroom behaviors were affected. 
Individual investigators (e.g.. Seller, 1974) have 
reported that teacher ratings of children with preschool experience 
differed from those of control children. Children's families may 
have been influenced by, for example, changing parents' perceptions 
of their children, affecting the family dynamics, increasing their 
hopes for the children's future. Again, we reported limited 
evidence that preschool affected maternal aspirations. But we have 
virtually no evidence about the influence of the larger social and 
historical context. How did desegregation and busing enter into 
thla picture? What difference did it make to enroll a child in 
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intervention programs at the height of a societal comndtment to 
socUl change? What will be the effect of the current disillusion 
with social legislation and spending? To answer these questions, 
investigators must continue to design and carry out further 
longitudinal studies. The Consortium for Longitudinal Studies hag 
provided a baseline from which tt- operate by demonstrating that 
preschool intervention programs can make a lasting difference in 
lives of low-income children. 
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SUMMARY AND IMPLICATIONS 

Thi» report contaios the analyses of longitudinal data designed 
to measure the effects of preschool intervention programs on low- 
incoae children. These analyses were conducted by the Consortium for 
Longitudinal Studies, a group of 14 investigators, 12 of whom had 
designed and operated intervention programs in the 1960s. The 
original investigators had hoped to increase low-income children's 
ability to perform adequately in school. Many also had goals such 
as influencing children's and families' attitudes toward school, 
increasing feelings of self-worth, etc. In this respect they were 
similar to (and some were harbingers of) Head Start. They were 
dissimilar in that all the programs were also designed as research 
projects. Now, 10 to 15 years later (depending on the inception 
of each program) it is possible to evaluate whether and to what 
extent these preschool intervention programs had any impact on 
children's livco. 

Let us consider first the goal of increasing children's school 
performance and the (sometimes more in^licit) goal of influencing 
their cognitive ability. The Consortium has three kinds of measures 
relevant for evaluating the preschool programs' success in terms of 
these goals: IQ test scores, children's school status during their 
school careers, and children's achievement test scores. 

Children participating in preschool programs and the control 
children were given IQ tests at least three times: before inception 
of the program, at age 6, and in a 1976-77 follow-up study when 
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they vera 9 to 19 years old (depending on the particular program 
they attended). The results of coo^aring treatment and control 
children were very clear. Before preschool experience, the IQ 
scores of the tvo groups did not differ. At age 6, treatment 
children scored significantly higher than controls on IQ tests. 
Treatment children maintained this superiority for at least 3 
years after the end of the preschool program (cf. Consortium, 
1977). By the time of the 1976-77 follow-up, however, there 
were no significant differences between treatment and control 
children on tflSC-R scores (including the full, verbal, and 
performance IQ scores and the WISC-R subtest scores) in roost 
projects. The Levenstein and Palmer projects, whose children 
were less than 13 years old. did find treatment /control 
differences. We tested the possibility that treatment effects 
on WISC-R scores were masked because only some kinds of children 
were affected. There was no evidence, however, that preschool 
affected WISC-R scores of girls more than boys or that it 
differentially affected children whose mothers had completed 
iBore vs. less education. Nor was there any evidence that 
preschool helped some children and hurt others (by, for example, 
making later school classes seem dull in comparison) . Thus , we 
can conclude that preschool programs resulted in short term 
gains In IQ scores for a period of at least 3 years after the 



^ Family structure (father absence vs. presence), family size 
(au»b«v of siblings) and level of education completed by the 
child's mother. 



173 

program ended, but that those gains were not in evidence in those 
projects whose children were 13 years old or older. 

IQ scores serve as an operational definition of intelligence 
or cognitive ability; but this use of intelligence tests has been 
the subject of much controversy. Since the original intervention 
programs were aimed at influencing children's school performance, 
the Consortium gathered information from the schools about children' 
school careers. Children who avoided grade failure (retention in 
grade) and avoided assignment to special education classes were 
clearly able to meet at least the minimum requiranents of their 
schools. Let us now examine the evidence that preschool affected 
these basic measures of school performance. 

Findings were strong regarding the effects of preschool on 
these measures of school performance. Children who attended 
preschool were only about half as likely as control children to 
be assigned to special education classes. They were also less 
likely to be retained in grade. These results also held true 

whea we controlled for effects of children's initial IQ score, sex, 
ethnic background, and three measures of family background (recorded 

prior to the program) , 

Furthermore, there was evidence that all these low-income 

children were helped; that is, benefits were not limited to children 

with higher initial IQ scores, to boys vs. girls, to white vs. 

Black children, to children from two-parent vs. one-parent homes » 

to children wxth fewer vs. more siblings, or to children whose 

mothers had more vs. less education. 
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Some critics have aaintained that preschool effects on school 
perforaance come about through temporarily raising IQ scores, which 
thus causes teachers to label these children as brighter. To test 
this hypothesis, we partialled out the effects of preschool on IQ 
scores at age 6. Even when controlling for preschool 's effect on 
cognitive ability (as measured by the IQ test), the preschool 
variable still independently predicted assignment to special 
education classes (with treatment children less likely to be so 

« 

assigned) . 

Generally, results from retention in grade were somewhat 
weaker than those for assignment to special education. In 
retrospect, we attribute this to two reasons: (a) many school 
districts had automatic promotion policies, with a resultant smaller 
variation among children; (b) a higher proportion of control 
children were assigned to special education classes; once in such 
classes they were less likely to return to regular classes and 
be retained in grade. 

Achievement test scores provide another measure of school 
performance, insofar as they reflect the content children learned 
in thtlr classrooms. Our analyses of achievement tests are in the 
early stagea, but already it is evident that treatment children 
Bcorad higher than control children at the fourth grade level. 
The difference between the groups was significant for aiath 
achlevefl«nt tests; in the median project, treatment children were 
about a half-grade ahead of the control children. 
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In summary t it i^)pears that the preschool prograiBS directed 
by ConsortiusB oembers had substantial and lasting effects on the 
school performance of low- income children • Treatment children were 
more likely to meet the minimiua requirements of their schools. 
They were also more likely to score higher on standardized math 
achievement tests in the fourth grade. 

Once having established that pre^^nhool programs affected later 
school performance 9 we turned to questions of program characteristics. 
What kinds of progr^ns had the best records in terms of enabling 
children to later avoid asslgni^nt to special education? Did certain 
kinds of programs seem to work better for some kinds of children? 
For example i did girls benefit more than boys from higher adult/ 
child ratios? Ten different program characteristics were examined 
in this way: age of children -^t Intervention, the length of the 
Intervention (in both years and months per year), the number of 
hours per year of instruction, the level of parent involvement, the 
presence or absence of language goals, the existence of preservlce 
training for teachers, the degree of structure in the teaching 
methods, the location of the program (center vs. home), and staff 
characteristics (professional vs. non-professional). In these, our 
most recent analyses, we could find little evidence that some 
characteristics were more helpful than others. Furthermore, there 
was no evidence that these dharacterlstics were differentially 
successful with children who varied by sex, initial IQ score, ethnic 
backgroimd, family structure and size, and maternal educational 
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level. While there was variation among the programs in terms of the 
ten program characteristics » they were similar in the sense that all 
were well-rxm, high quality programs. In brief, then, it appears 
that all low*income children can benefit from well-run preschool 
programs when the measure of program effectiveness is assignment 
to regular vs. special education classrooms- 

Finally, we explored the question of how preschool programs 
exerted their effect. As Gray pointed out (Klaus & Gray, 1974), it 
is highly unlikely that an "innoculation" of preschool could protect 
children from school failure over the ensuing 12 years. Furthermore, 
the fact that preschool atte. mce predicted assignment to regular 
classrooms even after controlling for its influence on cognitive 
ability suggested that non-cognitive aspects of development were 
affected as well. We considered four areas in detail as possibly 
showing evidence of persisting preschool influence: maternal 
aspirations for their children, children's later achievement 
orientation, children's self-evaluation, and children's sociability. 
There were strong resultfc^ for two dependent variables. First, 
nothers of children who had attended preschool had much higher 
vocational aspirations for their children than the childm had for 
themselves (discrepancy score) . This pattern was not true for 
aothers of control children and their offspring. Secondly, children 
who had attended preschool were much more likely to mention 
achlevea»nt- related reasons for feeling proud of themselves. This 
was especially true for girls. 

2 is 
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Another exploratory analysis was undertaken to determine if 
families of treatment and control children differed in their use 
of Title IV child Welfare services. Although the method of using 
archival records from the various states proved workable, no 
significant differences emerged in the use of these services. 
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Implications 

The first report of the Consortium for Longitudinal Studies 
(Consortium, 1977) concluded that preschool intervention programs 
helped low- income children meet the minimal requirements of their 
respective schools, either by reducing the rate of placement in 
special education or by avoiding grade failure 
(retention in grade). Most of our work over the past year 
constitutes an attempt to understand the mechanisms, or to limit 
or qxjalify, that earlier general conclusion. 

Using the children's school outcomes (i.e., assignment to 
special education classes, retention in grade) as dependent 
variables, we questioned whether some kinds of children benefitted 
more from preschool than others. 

The answer was no. 

We queried whether some program characteristics were more 
successful than others in reducing later assignments to special 
education classes. 

The answer, using these data, was no. 

We tested whether some program characteristics were more 
successful with certain kinds of children using assigiment to 
regular vs. special education classes as the criterion for success. 

Again, the answer was no. 

Whether controlling for IQ at age 6 — when the effects of 
preschool attendance on IQ scores are at their greatest — or for 
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IQ prior to intervention, the experimental-control differences in 
special education placement remained significant. The same was true 
vhen ve controlled for background variables, 

ThuSt this report emerges with the same general conclusion, 
buttressed by laore extensive evidence: all these high-quality 
preschool programs apparently benefitted their low- income participant 
by enabling them to meet the minimal requirements of their school 
systems. In addition, we have added to v>xa conclusion another 
indication of how the children were helped: children who attended 
preschools scored higher than control children on math achievement 
tests in the fourth grade with a suggestive trend toward scoring 
higher on reading achievement tests as well* 

The fact that we found no Interactions between children's 
early family backgrotmds, their early intellectual abilities, and 
their later school outcomes will surprise many scholars. And, 
of course, policy makers will be disappointed that no one program 
characteristic emerged as superior in these analyses. We ourselves 
did not expect these results. To some extent, these negative finding 
were due to the dependent variables used. Assignment to special 
education and retention in grade are molar measures. They are also 
dichotomous: children either did or did not benefit. It may be 
necessary to use more sensitive outcome measures in order to detect 
interaction effects. Our future plans include repeating all these 
axialyses using achievement test scores as the outcome measure. 
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We should also like to point out, however, the strengths of 
the outcome measures we used. Assignment to special education and 
retention in grade are meaningful at the level of the individual 
child; that is, s/hs faces the possibility of experiencing either 
one or both, and these events have important real-life consequences 
for him or her, as we detailed earlier in this report. The measures 
are also useful in a social sense. They are comprehensible to lay- 
people as well as to professionals. Furthermore, it is possible to 
assign dollar values to special education programs (and, to a lesser 
extent, to grade failure) so taxpayers and decision-^makers can readily 
see the benefit of avoiding special education placement and retention 
in grade in dollar and cents terms. In fact, if legislators were to 
look to the Consortium on Longitudinal Studies for advice on how to 
spend taxpayers* dollars, we would answer imequivocally : allocate 
money to preschool intervention programs. Allocate enough funds 
(and to the appropriate recipients) to ensure that the programs will 
be well-run. In terms of enabling lower-income children to avoid 
placement in special education classes and/or retention in grade, 
it appears to be a sound social investment. 

The other outcome variable included here was IQ test scores, 
measured in 1976-77 when children ranged from 9 to 19 years old. 
In general, there were no treatment/control differences on full, 
verbal, or performance WISC-R IQ scores or on the subtests in those 
projects whose participants were 13 years of age or older. This 




181 



result should be considered in the context of finding large and 
reliible treatment/control differences on the other outcome measures, 
Ve believe that this result implies that caution should be exercised 
in using IQ scores as outcome measures for intervention programs, 
particularly over a long period of time. These results support 
Zigler's aad Trickett's (1978) recent questioning of the utility 
and meaning of IQ scores in evaluation research. 

Finally 9 we will mention again that some of the analyses 
included in this report point to preschools* effects on children's 
achievement-orientation and on parents* aspirations for their 
children. This, in conjunction with the treatment /control 
differences on school outcomes and achievement tests » implies 
that future research might focus on the non-cognitive (or social 
coi^etence) area» so that we may be able to specify further effects 
of preschool and to explore the processes by which preschool 
exerts its impact. 
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APPENDIX A 
Attrition 

One of the most serious threats to any longitudinal study is 
the problem of attrition — the fact that, over time, some of the 
subjects drop out cf a study (due to moving, death, or a tsyriad of 
other reasons) . 

The analysis of whether attrition has caused biases in the final 
sample will be directed towards answering four specific questions: 

1. Are there different rates of attrition for treatment and 
control grotips? 

2. Do the final samples differ on some important characteristic 
from the dropouts? 

3* Are there any instances of differential attrition? That is, 
are different kinds of children sele^ctively retrieved in experimental 
groups than in control groups? 

4. Do final program samples and final control samples differ 
on some important characteristics? 

The first three of these questions are questions on attrition 
in the strict sense of the term^ That is, they answer the question 
of the extent to which final sample treatment and control groups 
represent the original sample groups. The usefulness of such 
information in large measure hinges on the demonstrated — or 
assumed — initial equivalence of the treatment and control 
groups. If they were equivalent initially, attrition analyses 
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provide a method of assessing the extent to which the final treatment 
and control groups reiaain equivalent. This essential underlying 
issue of the equivalence of the final treatment and ontrol groups 
is addressed directly by our question 4. Accordingly, while 
question 4 is not, strictly sp /hi - a question of attrition, it 
conq>lements the attrition analysis per se and provides perhaps the 
strongest test of the degree of sampling bias in the Consortium's 
final follow-up saiE^leSr 

The Consortium follow-up involved the collection of four types 
of information, or instrun^nts: individual intelligence tests, 
interviews of children and mothers, and school records. For 
purposes of this report, attrition is defined as the failure to 
report information for a particular child on a particular 
instrtiment. This definition is applied because the different 
methods for collecting information occasionally resulted in 
considerable divergence among the samples receiving different 
instrximents. For example, collection of Youth Interview and 
WISC-R data required actual contact with the child, while collection 
of the School Record Form data required, instead, actual contact 
with the child's school records — a feat which could be either 
more or less difficult than actual contact with the child, depending 
on the cooperation and organization of the school district. 

Virtually all of the attrition was due to simple inability to 
locate subjects or other sources of data, such as parents or school 
records. Less than 3Z of our subjects or parents refused to 
participate. 
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Attrition In the Current Follow-up 
There are five measures of attrition in the current follow-up: 

- whether a Parent Interview was reported; 

- whether a Youth Interview was reported; 

- whether a School Record Form was reported; 

- whether a WISC-R was reported; and 

- whether any of the above was reported (referred to hereafter 
aa "general attrition"). 

All four of the questions above have been addressed with regard to 
each of these five measures of attrition. For each of the five 
measures 9 questions 2, 3, and 4 have been answered with respect to 
three potentially important covarlates: pretest IQ, mother's 
education at the time of the child's entry into preschool, and 
household SES (Hollingshead Two-Factor Index of Social Position) at 
the time of the child's entry into preschool. For the sake of 
clarity, the discussion here will focus primarily on the measures 
of "general attrition." 

The results htre are reported on nine projects: Seller, Deutsch, 
Gordon, Gray, Karnes » Levenstein, Miller, Palmer, and Weikart.^ 
The percentages of children found (on any instrument) are givtn in 
Table A-1. Our definition of original data is also found in this 
table. We have excluded certain groups from analyses in this report 



Woolman^s project has no background demographic data of the sort 
used in the present analysis, and Zigler's project has very little 
such data that fit the Consortium format. 
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(unless otherwise noted) , and thus have decided to exfclude them 
from our attrition analysis. Gray's group 4 (the "distal control 
group") differed from her other (randomly assigned) groups in 
several respects and hence has been excluded. Recently completed 
analysis of retrospective demographic data from Seller's project 
indicated that group 3 (first grade without kindergarten or 
preschool) was dissimilar to the other groups. We have excluded 
Miller's groups seven and eight since we have no original 
demographic data for them. And for Karnes' project, we have 
reported data only for her groups one through seven, since these 
are the planned curriculum variation groups which we have used for 
our program variable analyses. 

The groups used in the school record form analyses are 
different from those used in the other attrition analyses for two 
projects, Gordon and Levenstein. In order to compare children 
within the same school system, we have excluded from Gordon's projec 
children living outside Alachua County. In Levenstein' s project we 
have excluded group 19 since this is a control group added on at 
first grade. These exclusions correspond to the data which were 
actually used in the special education and retention analysis. 

The analyses reported here and some further analyses showed 
the attrition problems for the Deutsch project to be far nwre 
severe than those for other projects. Not only was the attrition 
rate far higher, but the Deutsch team recovered primarily the best 
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trMtiaent-*groiq> subjects and the worst control^group subjects. These 
probleos are described in detail in the section of this report 
describing individual projects. As a result, we were forced to omit 
the Deutsch data from all of our most important analyses. Therefore 
the rest of the text in this section will consider primarily the 
eight projects remaining after the Deutsch project is deleted, 
although the tables in this section include the Deutsch project. 

Table A-1 shows that with the Deutsch project excluded, 
recovery rates ranged from 35. 8Z to 100%, with a median of 74.5%. 
Given the long time intervals involved — up to 14 years after the 
completion of preschool — the average seems reasonably good. 
Tables A-2 - A-5 show the comparable figures for specific dependent 
variables. The picture is much the same as in Table A-1* 

Tables A-1 - A-5 also show the results of significance tests 
testing whether recovery rates differed for treatment and control 
groups. Altogether 32 such tests were perfonaed (excluding Deutsch), 
so we would expect to find one or two significant differences just 
by chance^ but no differences significant at the .05 level were 
found. In fact^ in these 32 tests no p values were observed below 
.15, so none of the differences even approached significance. This 
provides a very clear answer to question 1 in our opening list — 
were different rates of attrition found for treatn^nt and control 
groups? The answer is no. 
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With respect to general attrition (Table A-1), all projects found 
roughly the bm» percentage of control children as they did of 
prograa children (i.e., there appears to be no indication of 
different rates of attrition between program and control groups) « 
Thus, the answer to the first question is negative. However, the 
percentage foimd does vary widely aawng projects. The median 
percentage found is 73.8. Tables A-2 - A-5 present similar analyses 
for the individual instriin«nts. 

Questions 2, 3, and 4 are answered in Tables A-6 - A-20. These 
15 tables result from crossing the five taeasures of attrition 
(Parent Interview, Youth Interview, WISC, School Record, and 
"general attrition'' [any instrtunent obtained]) with the three 
covariates mentioned above: pretest IQ (usually, Stanford-Binet) , 
Hollingshead Index of Social Position, and mother's education (in 
grades completed). (As mother's education enters into the 
calculation of the ISP in father absent homes, this measure 
overlaps considerably with mother's education.) 

Column 1 in each of these tables reports the significance 
levels of tests which tested whether the recovered and unrecovered 
groups differed on any of the background measures (IQ, mother's 
education, and SES, all measured before the beginning of preschool) - 
Question 2 in our list. Altogether Column 1 in Tables A-6 - A-20 

^ The only significant differences found were on Deutsch parent 
interviews and school record forms. 
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reports 107 hypothesis tests of this sort. Of these 107 p values, we 
would eaq)ect 10 or 11 to be below .10 by chance, and 10 were. Thus 
the number of significant or nearly significant results is altwst 
exactly what would be e:qpected by chance. The smallest one of the 
107 £ values was .OlS, Among 107 independent p values, the 
probability is .80 that at least one p value would be as small as .015. 
Thus, by this measure also, the set of p values testing Question 2 
is essentially what one would one would e^qject by change. 

Qtsestion 3 asked whether different kinds of subjects were 
recovered in the treatment-group and control-group samples. For 
instance, if the brighter treatment-group children and the less 
bright control-group children were recovered, then in the recovered 
saBQjle the difference between mean age 3 IQ's of treatment and 
control children would be larger than in the original sample. By 
the same token, this difference would be larger for the recovered 
children than for the lost children. Thus Question 3 concerns a 
difference between differences, or an interaction in an ANOVA 
table. If we form a 2 x 2 table of treatment vs, control and lost 
vs. recovered subjects, and enter n^an age 3 IQ scores in the four 
cells, then an ordinary ANOVA test for interaction will test 
whether different kinds of children were recovered in the treatment 
group than in the control group. 

VJhere possible, the interaction analysis just described was 
performed 15 times for each project. It was performed separately 
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for each of three background variables: age 3 IQ, mother's education, 
and Hollingshead SES. For each of these three variables, it was 
perfomed five tioes — once for each of the five kinds of attrition 
mentioned earlier. Because of missing data in various categories, 
the total n\in4jer of interaction tests performed was 76. The p^ values 
for these tests are shown in coluam 2 of Tables A-6 - A-20. Of the 76 
p values, 10 were below .10, while seven or eight such values would 
be expected by chance. The smallest of the 76 g values was .032, 
which again is well within what one might e>q>ect by chance. 

Although not shown in this report, similar interaction tests 
were also performed on three other background variables — father 
presence or absence at the beginning of preschool, number of 
siblings at that time, and Stanford-Binct IQ score upon completion 
of the project. The results of these analyses are essentially the 
same as those reported in the last paragraph, with one exception: 
in the Deutsch project there was a significant (p - .001) tendency 
for school records to be recovered for the treatnwint-group 
children measured as brightest at the end of preschool, and for 
the least bright control children. Thus using the recovered 
Deutsch data would seriously exaggerate the effectiveness of the 
Deutsch preschool program. Therefore the Deutsch data was omitted 
from the simnuaries of most of our analyses. This is discussed in 
more detail in this report's section on project descriptions. 
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Question 4 does not concern attrition per se , but it does concern 
the types of bias which attrition might produce, so it is included 
here. In the recovered samples, were there significant differences 
between treatment and control groups on any of the background 
variables — age 3 IQ, mother's education, or HoUingshead SES? 
Again, when data were available, we tested this question in 15 
different ways for each project. The p values for these tests 
appear in column 3 of Tables A-6 - A-20. The 93 tests thus performed 
yielded eight p values below .10, while 9 or 10 would be expected by 
chance. However, seven of eight p values were .011 or below, which 
is low enough to require some discussion. 

The Levenstein sample showed p values of .085, .011 and .011, all 
indicating a difference between recovered treatment and control groups 
on HoUingshead SES. However, in our moat inqiortant analysis, the 
Levenstein project was classified as nonexperimental, thus limiting 
the potential biases introduced by this problem. Also, there was 
no hint of such bias in mother's education, which of course 
correlates with SES. When it is recalled that a p value of .011 
could well occur by chance among 93 tests, we are inclined to view 
this as a rather mild source of bias. 

The remaining five small p values in column 3 of Tables A-6 - A-20 
all show highly significant differences on age 3 XQ between recovered 
treatment and control groups in the Palmer project. On "general 
attrition" (failure to recover any follow-up data concerning a 
child), the difference is significant beyond the .0001 level, and 
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on the four more specific kinds of attrition the differences are 
also highly significant. On general attrition, the difference is 
a 9-point IQ difference favoring the program group. Since Palmer 
used an essentially random procedure of assigning children to 
program and control groups, it is difficult to understand how such 
a large difference could have occurred. Two things lead us to 
believe that at least part of this difference is spurious. First 
of all, the control children were tested at an average age of 2 
years and 9 months, while the average age of the program children 
was 3 years. The norming of the Stanford-Binet is dubious at young 
ages, especially for lower SES children. Secondly, there are no 
differences for these same children on demographic variables. For 
example, of the children who were given a pretest IQ, the 
program children's mothers have completed an average of 11.39 years 
of education, while the control children's mothers have completed 
11.38 years of education. Similarly, the average Hollingshead 
score for the program children is 58.83; for controls, 57.28. 
(A higher score indicates a lower socioeconomic status.) These 
figures lead us to believe that Palmer's program and control groups 
are more alike than the pretest IQ data indicate. In this report, 
whenever possible, we have controlled for pretest IQ to help 
alleviate this initial difference. 

Readers who are familiar with the Consortium work may notice 
some discrepancies between these attrition results and those of our 
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pravioua report (Consortium, 1977) • Any discrepancies are due to 
two factors • First of all, after our 1977 report we received data 
on nar cases. Secondly, in some cases, we defined the groups to 
be considered in a different way than before. In all such 
instances, we have defined final saxqple program and control groups 
to produce the nost equivalent groups possible. 
Conclusions 

Some of our central staff members joined this project with 
serious suspicions concerning attrition and its potential for 
biasing our major analyses. As a result, our analysis of attrition 
has been far more ext^isive than those we have seen in most other 
longitudinal studies. We related five types of attrition to three 
background demographic characteristics, examining four different 
questions related to attrition. We reported altogether over 300 
significance tests, any one of which was potentially capable of 
finding a significant difference between treatment and control 
groups in some respect. Our total attrition analysis has actually 
been approximately twice as extensive as that reported here. We 
have reported here results concerning three background variables — 
mother's education, pretest IQ, and SES. We have also largely 
completed comparable analyses for two other background variables — 
family size and father presence or absence — and have done some 
attrition-relate analyses on IQ at age 6. With minor exceptions 
discussed in this section, it turned out that it would be hard to 
imagine a set of results irore consistent with the hypothesis that 
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attrition was ••■•atially randon, introducing no noticeable biases 
into our other analyses. The minor exceptions have been considered 
In our major analyses. 
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Project 
(Groups) 



T*ble A-1 

Final Sample As A Percent of Original S^iple By Project 



Final 
Controls 
as X of 
Originals 
Controls 



Final 
Program 
as X of 
Original 
Program 



Total Final 
Saapla as X 
of Original 
Total 
Sample 



Significance 
(two-tailed) 



Definition of 



Seller 

r ^ 1 ^ 


66.0**(35)* 
(53)* 


66.1(39) 
(59) 


66.1(74) 
(112) 


.0001 


.9920 


GrouDS 1 and 2 ■» 112 biases 


Deutsch 


16.1(31) 
(192) 


19.2(60) 
(312) 


18.1(91) 
(504) 


.7645 


.3819 


r xrs^ <4 waves 1 uroups i and 2^ 
only 504 cases 


Gordon 


35.8(24) 
(67) 


34.3(83) 
(242) 


34.6(107) 

(309) 


.0538 


.8166 


All ^OQ ^HSOO ^Vi t^Aaf" ai^nvAo 

sent to Cornell 


(1-3) 


(21) 


81.8(36) 
(44) 


84.6(55) 
(65) 


.8186 


.2656 


Croups 1 thru 3-65 cases 


KcrnM 

(1-7) 




86.3(88) 
(102) 


86.3f sa 

(102) 






vji&wuptt X i.n£^u / ^ cases 




77.9(53) 
(68) 


74.2(135) 
(182) 


75.2(188) 
(250) 


.3763 


.5396 


All 9 ^ A ttftcz aon^ 1 

(first 5 waves) 


Miller 
(1-5) 


52.9(18) 
(34) 


50.9(109) 
(214) 


51.2(127) 
(248) 


.0473 


.8278 


Groups 1 thru S ■ 248 cases 


Falser 


71.6(48) 
(67) 


74.4(180) 
(242) 


73.8(228) 
(309) 


.2034 


.6520 


All 309 cases sent to Cornell 


Velkert 


100(65) 
(65) 


100(58) 
(58) 


100(123) 
(123) 






All 123 Perry cases sent to 
Cornell 


Total" 


69.9(262) 
(375) 


63.7(728) 
(1143) 


65.2(990) 
(1518) 









* Without Yatea correction. 
** Percentage of original. 

+ Follov-up aaaple sizs. 

# Original aaaple size. 

#1 Deutsch sasple is excluded froa total. 



See Camilli and Hopkins (1978) 
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Table A-2 





Final Sample As A 


Percent of Original Sampl 


e for Parent Interview by Proj 


ect 








Total Final 






Project 


Final Controls 
as a % of 
Original Controls 


Final Program 
Original Program 


Sample as a 
% of Original 
Total Sample 


2* 

X 


Significance 
(two- tailed) 


Beller 


M ± 

CO Q /0Q^^ 

(53)^? 


(59) 


58.9(66) 
(112) 


1.5460 


.2137 


Deutsch 


9.9(19) 
(192) 


(312) 


14.3(72) 
(504) 


4.8812 


.0272 


Gordon 


35.8(24) 
(67) 


34.3(83) 
(242) 


34.6(107) 
(309) 


.0538 


,8166 


Gray 
(1-3) 


81.0(17) 
(21) 


(44) 


81.5(53) 
(65) 


.0071 


.9328 


Karnes 

\-'^' ^ , 




85.3(87) 
(102) 


85.3(87) 
(102) 






Levenstein 


(68) 


(182) 


39.2(98) 
(250) 


1.1329 


.2871 


Miller 


(34) 


(214) 


51.2(127) 
(248) 


.0473 


.8278 


Palmer 


46.3(31) 
(67) 


46.3(112) 

/ T A 0 \ 


46.3(143) 
(309) 


-i, . UUU i- 


.9986 


Ueikarc 


86.2(56) 
(65) 


86.2(50) 
(58) 


86.2(106) 
(123) 


.0001 


,9932 



* Without Yates^ correction. See Camilll and Hopkins (1978) . 
** Percentage of original. 

* Follow-up sample size. 
Original sample size. 



o 

to 



2 id 
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Table A- 3 





Final Sample As A 


Percent of Original for Youth Interview, 


By Pro.lect 




Project 
(Groups) 


Final Controls 
as a 2 of 
Original Controls 


Final Program 
as a % of 
Original Program 


Total Final 
Sample as a 
% of Original 
Total Sample 


* 


Significance 
(two- tailed^ 


Seller 


58.5*t31)* 
(53)^ 


59.3(35) 
(59) 


58.9(66) 
(112) 


.0080 


.9288 


Deutsch 


14.1(27) 
(192) 


17.6(55) 
(312) 


16.3(82) 
(504) 


1.1093 


.2922 


Gordon 


28.4(19) 
(67) 


30.2(73) 
(242) 


29.8(92) 
(309) 


.0820 


. 7746 


Gray 
(1-3) 


81.0(17) 

(21) 


75.0(33) 
(44) 


76.9(50) 

(65) 


.2837 


.5943 


Karnes 
(1-7) 


— 


79.4(81) 
(102) 


79,4(81) 
(102) 


— 


— 


Levensteln 


36.8(25) 
(68) 


27.5(50) 
(182) 


30.0(75) 
(250) 


2.0354 


.1537 


Miller 
(1-5) 


52.9(18) 
(34) 


50.9(109) 
(214) 


51.2(127) 
(248) 


.0473 


.8278 


Palmer 


47.8(32) 
(67) 


46.3(112) 
(242) 


(309) 


.0462 


.8298 


Weikart 


87.7(57) 
(65) 


81.0(47) 
(58) 


84.6(104) 
(123) 


1.0402 


.3078 


* Without Yates 


correction. See Camilli and Hopkins (1978) 


• 







ERIC 



** Percentage of original. 
^ Follow-up sample size. 
' Original sample size. 

247 



O 



248 



Final Sample As A 



Table A-4 

Percent of Original for School Record Form, By Project 



Project 
(Groups) 



Final Controls 
as a % of 
Original Controls 



Final Program 
as a % of 
Original Program 



Seller 
Deutsch 



Gordon 



Gray 
(1-3) 

Karnes 

(l-V) 

X«evenstein 



Miller 
(1-5) 

Palmer 



Weikart 



62.3*t33)'' 
(S3r 

6.3(12) 
(192) 

23.2(13) 
(56) 

90.5(19) 
(21) 



56.1(23) 
(41) 

52.9(18) 
(34) 

71.6(48) 
(67) 

100.0(65) 
(65) 



62.7(37) 
(59) 

12.5(39) 
(312) 

29.8(68) 
(228) 

81.8(36) 
(44) 

76.5(78) 
(102) 

57.1(104) 
(182) 

50.0(107) 
(214) 

72.7(176) 
(242) 

100.0(58) 
(58) 



Total Final 
Sample as a 
% of Original 
Total Sample 



* Without Yates correction. See Camilli and Hopkins (1978). 

Percentage of original. 

^ Follow-up sample size. 
I 



62.5(70) 
(112) 

10.1(51) 
(504^ 

28.5(81) 
(284) 

84.6(55) 
(65) 

76.5(78) 
(102) 

57.0(127) 
(223) 

50.4(125) 
(248) 

72.5(224) 
(309) 

100.0(123) 
(123) 



#« 



Original sample size. 



.0024 



5.1048 



.9636 



.8186 



,0149 



.1015 



.0310 



Significance 
(two- tailed) 



.9609 
.0239 
.3263 
.3656 



.9028 



.7500 



.8602 



Gordon: Alachua County School District only; Levenstein, excluding Group 19, 



Table A-5 





Final Sasnple 


As A Percent of Original For WISC-R, 


By Project 




Project 
(Gr«ups: 


Final Controls 
as a Z of 

Original Controls 


Final Program 
as a S OX 
Original Program 


Total Final 
Sample as a 
Z of Original 
Total Sample 


•2* 
X 


Significance 
(two- tailed) 


Beller*' 












Dftutsch 


14.6(28) 


(312) 


(504) 


.6476 


.4210 


Gordon 


28.4*tl9)+ 
(67)# 


29.3(71) 
(242) 


29.1(90) 
(309) 


.0244 


.8759 


Gray 


85.7(18) 
(21) 


77.3(34) 
(44) 


80.0(52) 
(65) 


.6331 


.4262 


Karnes 




77.5(79) 
(102) 


77.5(79) 
(102) 






Levenstein 


36.8(25) 
(68) 


27.5(50) 
(182) 


30.0(75) 
(250) 


2.0354 


.1537 


Miller 
(1-5) 


52.9(18) 
(34) 


50.9(109) 
(214) 


51.2(127) 
(248) 


.0473 


.8278 


Falser 


41.8(28) 
• (67) 


43.0(104) 
(242) 


42.7(132) 
(309) 






Ifeikart 


86.2(56) 
(65) 


93.1(54) 
(58) 


89.4(110) 
(123) 


1.5661 


.2108 


^ Vltbotit Yates 


correction* See Camilli and Hopkins (1978] 


1. 







•* Percentage of original, 
4* Follov-up sample sise. 
# Original sample size. 

n Beller is still collecting WISC data.' Deutsch scores are WAIS only. 
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Table A-6 

General AttritlOT "Comparison of Mother's Education 



Project 
(Groups) 

Seller 
(1,2) 

i;eutsch 
(1.2) 

Gordon 



Gray 
(1-3) 

Karnes 
(1-7) 

Levenstein 



Miller 
(1-5) 

Palmer 
Weikart 



Significance Levels 



Attrition Final Samp. 

Main Effect Interaction P-C Compar. 



Nc Data for Dropouts 



J73 
.161 



.505 



.277 



.174 



A 



.251 



No Dropouts on School 
Record 



309 



7 

.501 



.672*"^ 



.349 



.331 



.556 



.841 



♦ "A" iB^liea the F. for this test was less than 1 . 
Control group has higher mother's educational level. 

2bi 



ERIC 



Mean Grades Completed 



Control 



Program 



Dropout 



Final 
Sample 



Dropout 



Final 
Sample 



Overall 
Mean 



— 


10.69 


— 


11.14 


10.95 




(26) 








9.97 


10.35 


10.27 


10.13 


10.12 


(68) 


(17) 


(41) 


/CAN 






9.73 


10.43 


10.03 


in 1 Q 

10* 1? 




(15) 


(75) 


(67) 


(157) 


9.00 


9.11 


9.67 


8.79 


Q Q £2 




(19) 


(6) 


(34) 


(61) 






10.54 


10.07 


10.13 






(13) 


(84) 


(97) 


10.93 


10.28 


10.33 


10.61 


10.51 


(15) 


(53) 


(46) 


(134) 


(248) 


10.67 


10.29 


10.89 


10.87 


10.82 


(15) 


(17) 


(95) 


(100) 


(227) 


11.42 


11.27 


11.48 


11.13 


11.23 


(19) 


(48) 


(54) 


(178) 


(299) 




9.38 




9.47 


9.42 




(65) 




(58) 


(123) 



O 
ON 



Table A- 7 

General Attrition - Coaparlson of Holllngshead ISP Scores* 

Mean ISP Scores 



Significance Levels Control Program 



Project 
(Groups) 


Attrition 

Main Effect Interaction 


Final Samp. 
P-C Compar. 


Dropout 


Final 
Sample 


Dropout 


Final 
Sample 


Overall 
Mean 


Seller 
(1,2) 


No Data for Dropouts 


.795 


— 


56.95 
(19) 




57.95 
(20) 


57.46 
(39) 


Deutsch 
(1,2) 


.357 .474 


.519 


65.90 
(68) 


66,11 
(9) 


67.02 
(41) 


64.91 
(44) 


65.93 
(162) 


Gordon 


.297 


— 


.... 




63.14 
(71) 


65.10 
(40) 


63.81 
(111) 


Gray 
(1-3) 


.185 .126 


.615 ' 


73.00 
(2) 


69.84 
(19) 


63.60 
(5) 


70.52 
(31) 


69.77 
(57) 


Karnes 
(1-7) 


.969 — 


— 


— 


— 


65.38 
(13) 


65.28 
(80) 


65.30 
(93) 


Levenstein 


a'' .150 


.171 


64.27 
C15) 


65.98 
(53) 


66.37 
(46) 


64.11 
(133) 


64.94 
(247) 


Miller 
(1-5) 


No Data for Controls 








62.76 
(76) 


63.66 
(96) 


63.26 
(172) 


Palmer 


.062 A 


.597 


55.05 
(19) 


58-04 
(48) 


55.98 
(53) 


59.20 
(175) 


58.17 
(295) 


Veikart 


No Dropouts on School 
Record 


.376 




69.09 
(64) 




67.81 
(58) 


67.92 
(123) 


* The Holllngshead Index of Social Position (ISP) ranges 
class and "77" representing the lowest social class. 


from 11 to 77, 


with "11" 


representing 


the highest 


social 



Control group has lower ISP, i.e. higher SES level. 
"A" implies the £ for this test was less than 1. 



Project 
(Groups) 



Beller 
(1,2) 

Oeucsch 
(1,2) 

Gordon 



Gray 
(>3) 

Karnes 
(1-7) 



Levenstein* 



Miller 
(1-5) 

Palaer 



WeiVart 



Table A-8 

General - r.^y^rt-^n of Pretest Stanford-Binet iq Scores 



Significance Levels 



Attrition Saop. 
Main Effect Interaction P-C Coopar. 



A 

A* 



.628 



.071 



.503 



.493 



.406 



No Pretest IQ 



.885 



.837 
.197 
No Pretest IQ 
.083 



260 



.728 



.079 



No Dropouts on School 
Record 



<.0001 
.373 



2b 0 

ERIC 



# "A" implies the £ for this test was less than 1. 
*' Control group has higher pretest IQ score. 

* PPVT pretest IQ. 



Mean IQ Scores 



Control 



Prof^ram 



Dropout 


Final 
Saapla 


Propout 


Final 
Sample 


Overall 
Mean 


87.00 
(18) 


93.34 
(35) 


94.16 
C19; 


91.16 

V JO/ 


91.69 
(110) 


91.74 
(109) 


89,20 
(20) 


92.32 
<222) 


92.17 
(52) 


91.99 
(403^ 


78.50 
(2) 


88.67 
(15) 


89.88 
(B) 


89.33 
(36) 


88.89 
(61) j 






95.21 
(14) 


94.67 
(88) 


94.74 

\ 1U4^ 


87 20 
(5) 


83.59 
(22) 


81.41 
(44) 


84.53 
(132) 


83.82 
(203) 


86.50 
(18) 


84.84 
(45) 


89.86 
(29) 


95.87 
(91) 


91.28 
(183) 




78.54 
(65) 




79.57 
(58) 


79.03 
(123) 



O 

CO 



2 .J b 



Table A-9 

Attrition on the Parent Interview - Comparison of Mother Education 



Mean Grades Completed 



Significance Levels 



Control 



Project 
(Groups) 


Attrition 
Mfi.in Effect 


Interaction 


r xnai 5ai&p • 
P-C Coapar. 


Dropout 


Final 
Sample 


Propout 


Final 
Sample 


Overai 
Mean 


Seller 


No Data for Dropouts 


.309 




10,69 


— 


11.14 


10.95 


<1.2) 










(26) 




(35) 


(61) 


Deutsch 
(1.2) 


.626 


.721 


1.000 


m ^ 


10.00 


10.38 


10.00 


10.12 








I / 3; 


(10) 


C4S) 


(47) 


(122) 


vO£ixon 


.107 




. 701 


— 


9.73 


10.43 


10.01 


10.18 












(15) 


(75) 


(67) 


(157) 


urfty 




. 106 


.277vif 


7.50 


9.47 


9.67 


8.79 


8.98 


(1-3) 








(4) 


(17) 


(6) 


(34) 


(61) 




.292 








— 


10.50 


10.07 


10.13 


(1-7) 












(14) 


(83) 


(97) 


Leveosteln 


.287 


A 


.583 


10.58 


10.13 


10.64 


10.40 


10.51 










(45) 


(233 


(105) 


(75) 


(248) 


Miller 


A 


A 


.171 


10.67 


10.29 


10.89 


10.87 


10.82 


(1-5) 








(15) 


(17) 


(95) 


(100) 


(227) 


F«laer 


A 


A 


.696^' 


11.33 


11.29 


11.26 


11.16 


11.23 










(36) 


(31) 


(121) 


(111) 


(299) 


Weikart 


A 


.058 


.370 


9.78 


9.32 


8.00 


9.70 


9.42 










(9) 


(56) 


(8) 


(50) 


(123) 



to 
O 
so 



' "A" laplies the £ for this test vas less than 1. 
"control group has higher level of aether's education. 

ERIC 
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Table A-tO 

Attrition on the Parent Interview - COffiPagiSOn Pf liQllinSBhffftd IS? SCOreS* 

Mean ISP Scores 



Control 



Program 



Project 
(Groups) 


Attrition 
Main Effect 


Interaction 


Final Samp. 
p-C Compar. 


Dropout 


Final 
Sample 


Propout 


Final 
Saiaple 


Overall 
Mean 




No Data for Dropouts 


.796* 


— 


56.95 
(19) 


— 


57.95 
(20) 


57,46 
(39) 


Deutsch 


.281 


.369 


.202 


65.85 

(73) 


67.25 
(4) 


67.11 
(45) 


64.60 
(40) 


65.93 
(162) 


Gordon 


.297 


No Data for 
Controls 


— 


— 




63.14 
(71) 


65.10 
(40) 


— 


Gray 


A *# 


.033 


.437^f 


74.00 
(4) 


69.24 
(17) 


63.60 
(5) 


70.52 
(31) 


69.77 
(57) N, 
o 


Karnes 
(1-7) 


.698 




— 


— 


— 


64.36 
(14) 


65.45 
(79) 


65.29 
(93) 


Levenstein 


.177 


A 


.085 


64.53 
(45) 


67.70 
(23) 


64.31 
(104) 


65.23 
(75) 


64.94 

(247) 


Miller 
(1-5) 


.514 


No Data for 
Controls 








62.76 
(76) 


63.66 
(96) 


63.26 
(172) 


Palmer 


A 


A 


.441* 


57.47 
(36) 


56.87 
(31) 


57.76 
(120) 


59.22 
(108) 


58.17 
(295) 


Weikart 


.306 


A 


.482 


68.00 
(9) 


69.27 
(55) 


65.13 
(8) 


68.24 
(50) 


68.48 
(122) 



* The Hollingahead Index of Social Position (ISP) ranges from 11 to 77. with "11" representing the highest 

class and "77" represjaiting the lowest social class. i, b M 

' Control group has lower ISP, i.e. higher SES level. 
I# "A" lapliss th« F for this test was less than 1. 



Table A- 11 

Attrition on the Parent Interview - Comparison of Pretest Stanford-Binet Scores 













Mean IQ Scores 








Sisnlficanca Levels 




Control 


Program 




(Groups) 


Attrition 
Main Effect 


Interaction 


Final Samp. 
P-C Compar. 


Dropout 


Final 
Sample 


Propout 


Final 
Sample 


Overall 
Mean 


Beller 
(It 2) 

(1,2) 


.652 


A 
.169 


.509## 
.181 


88.64 
(25) 

91.88 
(116) 


93.46 
(28) 

86.62 
(13) 


94,25 
(20) 

92.22 
(229) 


91.03 
(37) 

92.67 
(45) 


91.69 
(110) 

91.99 

(403) 


Gordon 


No Pretest IQ. 


— 














Gray 


A 


A 


.982 


81.75 

(4) 


89.23 
(13) 


89.88 
(8) 


89.33 
(36) 


88.89 
(61) 


Karnes 

(1.7^ 


.947 


— 




— 


— 


94.60 
(15) 


94.77 
(87) 


ro 

94.75 M 
(102) 


Levexistein* 


.026 


No Data on 

Follow-up 

Controls 


— 


84.26 

(27) 


— 


82.00 
(101) 


86.11 
(75) 


83.82 
(203) 


Miller 


No Pretest IQ 
















Palmer 


A 


A 


.000 


85.85 
(33) 


84.73 
(30) 


93.13 
(64) 


95.89 

(56) 


91.28 
(183) 


Weikart 


A 


A 


.582 


78.00 
(9) 


78.63 
(56) 


81.00 
(8) 


79.34 
(50) 


79.03 
(123) 



ERIC 



* "A" implies the £ for this test was less than 1. 
i# Control group has higher pretest IQ score. 

* PPVT pretest IQ. 

26i 
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Project 
(Groups) 



Seller 
(1.2) 

Deucsch 
(1,2) 

Gordon 



Oray 
(1-3) 



Karnes 
Tl-7) 

! evensteln 



^Hller 
(1-5) 

Palmer 



VJeikart 

261 



Table A^12 

Attrition on the Wh Interview - Compariso n of Mother's Education 



Mean Grades Completed 



Si f^iflcance Levels 



Control 



program 



Attrition 
Main Effect 



Interaction 



No Data for Dropouts 



.889 
.142 



.330 



No Data for 
Control 



Final Samp. 
P-C Co!i^>ar. 

.436 
.497** 

.768 



Dropout 



9.96 
(70) 



Final 
Sample 

10.92 
(25) 

10.47 
(15) 

9.73 
(11) 



Dropout 



Final 
Sample 



a "A" implies the F for this test was less than 1. 
^^^ControT group has higher level of mother^s education. 



ERIC 



10.33 
(45) 

10.40 
(83) 



11.23 
(31) 

10.06 
(50) 

9.92 
(60) 



Overall 
Mean 



11.09 
(56) 

10.12 
(180) 

10.17 
(154) 



.015 


.209 


.289 ^* 


6.50 
(4) 


9.71 

(17) 


8.00 

(9) 


9.19 

(31) 


8.98 
(61) 


.318 










10.40 

(20) 


10.06 
(77) 


10.13 
(97) 


.309 


A* 


.614 


10.40 
(43) 


10.12 
(25) 


10.59 
(130) 


10.40 
(50) 


10.51 
(248) 


A 


A 


.171 


10.67 
(15) 


10.29 
(17) 


10.89 
(95) 


10.87 
(100) 


10.82 
(227) 


A 


A 


.702^* 


11.37 
(35) 


11.25 
(32) 


11.29 

(121) 


11.13 
(111) 


11.23 
(299) 


.303 


.037 


.272 


10.00 
(8) 


9.30 

(57) 


8.18 
(11) 


9.77 
(47) 


9.42 
(123) 



to 



2() f 



Table A--13 

Attrition on the Youth Interviav - Comparison of Holllngshead liP Scores* 



Mem I5P Scores 





Significance Levels 




Control 




ram 




Project 
^v^rroups} 


Attrition 
Main Effect 


Interaction 


Final Saap. 
P-C Coffipar. 


Dropout 


Final 
Sample 


Dropout 


Final 
Sample 


Overall 
Mean 


(1,2) 


No Data for Dropouts 


.3/3 


— 


56,95 
(19) 




59.11 
(18) 


58.00 
(37) 


Deutsch 
(1,2) 


.424 


.645 


.706 


65.93 
(70) 


65.86 
(7) 


66.75 
(44) 


65.05 
(41) 


65.93 
(162) 


Gordon 




No Data for 
Controls 




— 


— 


63. 37 
(78) 


64 Q 7 
(33) 


(111) 


Gray 
(1-3) 


A 


.205 


.661* 


74.00 
(4) 


69,24 
(17) 


68 13 
(8) 


6Q 96 
(28) 


69 77 

\jy mil 

(57) 


Kames 
(1-7) 


.857 






— 


— 


65,60 
(20) 


65 21 
(73) 


65 29 
(93) 


Levenstein 


A 


.036 


.011 


64.33 
(43) 


67.80 
(25) 


65,16 
(129) 


63,50 
(50) 


64.94 

(247) 


Miller 
(1-5) 


.514 


No Data for 
Controls 








62.76 
(76) 


63,66 
(96) 


63.26 
(172) 


Palner 


A 


A 


.497* 


57.46 
(35) 


56.91 
(32) 


58.02 
(120) 


58.93 
(108) 


58.17 
(295) 


Welkart 


.016 


A 


.672 


66.50 
<8) 


69.46 
(56) 


63,09 
(U) 


68.91 
(47) 


68.48 
(122) 



* The Holllngshead Index of Social Position (ISP) ranges from 11 to 77, with "11** representing the highest social 
class and "77" representing the lowest social class. 

# Control group has lower ISP» i«e. higher SES level. 

' "A" Implies theX ^or this test was less than 1. ^ 



Table a- 14 

Attrition on the Youth Interview - Comparison of Pretest Stanford-Binet IQ Scores 



Project 
(Groups) 



Mean IQ Scores 



Significance Levels 



Control 



Attrition Final Samp. 

Main Effect Interaction P-C Conpar. 



Program 



Dropout 



Final 
Sample 



Final Overall 
Dropout Sample Mean 



Seller 
(1.2) 

Deutsch 
(1.2) 



.219 



.830 



.082 



.850 



.459 



.925 



86.82 
(22) 

91.24 
(112) 



94.29 
(31) 

92.06 
(17) 



92.83 
(23) 

92.27 
(226) 



91.71 
(34) 

92.38 
(48) 



91.69 
(110) 

91.99 
(403) 



Gordon 



No Pretest IQ — 



Gray 
(1-3) 


A 9 


A 


.908 


79.67 
(3) 


89.14 
(14) 


88.73 

(11) 


89.67 

(33) 


88.89 

(61) 


Karnes 
(1-7) 


.616 










93.76 
(21) 


95.00 
(81) 


94.74 
(102) 


Levenstein* 


.044 


No Data on 

Follow-up 

Controls 




84.26 
(27) 




82.62 
(126) 


86.60 

(50) 


83.82 
(203) 


Miller 
(1-5) 


No Pretest IQ 
















Falser 


A 


A 


.000 


85.59 
(32) 


85.03 
(31) 


93.24 
(66) 


95.85 
(54) 


91.28 
(183) 


Veikart 


A 


A 


.465 


79.75 
(8) 


78.36 
(57) 


80.55 
(11) 


79.34 
(47) 


79.02 
(123) 





' *'4" ii^lies the F for this test was less than 1. 
^ Control group has higher pretest IQ score. 



* FPVT pretest IQ. 



Table 

Attrition on the School Reeord - Comparison of Mother *s Education 



Mean Grades Coinpleted 



Significance Levels 



Control 



Program 



Proj ect 
(Groups) 



Attrition 
Main Effect 



Interaction 



Final Samp. 
p-C Compar, 



Dropout 



Final 
Sample 



Dropout 



Final 
Sample 



Overall 
Mean 



Belter 
(1,2) 


No Data on 


Dropouts 


.313 




10.72 
(25) 




11.18 
(33) 


10.98 
(58) 


Deutsch 
(1,2) 


.350 


.961 


.801 


10.07 
(80) 


9.60 

(5) 


10.40 
(58) 


9.86 
(37) 


10.12 
(180) 


Gordon* 


a' 


A 


.560 


9.44 
(9) 


9.57 
(7) 


10.30 
(87) 


10.04 
(56) 


10.13 
(159) 


Gray 
(1-3) 


A 


A 


.672^^ 


9.00 


9.11 


9.67 

(6> 


8.79 
(34) 


8.98 
(61) 


Karnes 
(1-7) 


.134 










10.56 
(22) 


10.01 
(75) 


10.13 
(97) 


Levemstein* 


A 


A 


. 34a'* 


10.93 
(15) 


. 10.91 
(23) 


10.49 
(77) 


10.57 
(103) 


10.61 
(218) 


Miller 
(1-5) 


A 


A 


.317 


10.67 
(15> 


10.29 
(17) 


10.88 
(97) 


10.89 
(98) 


10.82 
(227) 


Palsier 


.258 


A 


. 546*' 


11.42 
(19) 


11.27 
(48) 


11.47 
(58) 


11.13 
(174) 


11.23 
(299) 


Veikart 


No Dropouts 




.841 




9.38 
(65) 




9.47 

(58) 


9.42 
(123) 



# "A" implies the X ^or this test was less than 1. 

" Control group has higher mother's educational level t 

* Gordons Alachua County School District only- Levenstein: excluding Group 19. 2'/ 0 
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T«bl« A- 16 

Attrition on the School Record - Comparison of HollinKshead ISP Scores* 



Mean ISP score 





Sisnificance Levels 




Control 


Program 




Project 
(Groups) 


Attrition 
Main Effect 


Interaction 


B inai sajnp . 
F-C Compar. 


Dropout 


Final 
Sample 


Propout 


Final 
Sample 


Overall 
Mean 


Beller 
(1.2) 


No Data on Dropouts 


.753 * 




56.67 
(18) 




57,95 
(19) 


57.32 
(37) 


Deutsch 
(1.2) 


.306 


.508 


t not corqiutcd 


65.88 

(76) 


69.00 
(1) 


66.74 
(54) 


64.52 
(31) 


65.93 
(162) 


Gordon *^ 

Gray 
(1-3) 


Atf# 

.185 


No Data on 

Control 

Dropouts 

.126 


— 

.615 * 


73.00 
(2) 


69.84 
(19) 


63.70 
(80) 

63.60 
(5) 


64.22 
(31) 

70.52 
(31) 


63.84 
(111) 

69.77 
(57) 


Karnes 
(1-7) 


.695 




— 






65.95 
(22) 


65,08 
(71) 


65.30 
(93) 


Levenstein 


.023 


A 


.784* 


64.27 
(15) 


62.83 
(23) 


66.30 
(77) 


63.48 
(102) 


64.47 
(217) 


Miller 
(1-5) 


.800 


No Data on 
Controls 








62.92 
(78) 


63.34 
(92) 


63.15 
(170) 


Falsier 


.OAS 


A 


.565^ 


55.05 
(19) 


58.04 
(48) 


55.89 
(57) 


59.30 
(171) 


58.17 
(295) 


Waikart 


No Dropouts 




.376 




69.09 

(65) 




67.81 
(58) 


67.92 

(123) 



.* i-be Hollinsahead Index of Social Position (ISP) ranges from 11 to 77, with "11" representing the highest 
social class and "77" raprescntiog tha lowest social class. 

' Control group has lower ISP score, that is higher SES. 

I# "A" i^lias ths £ for this test was less than 1. 

•* Cordons Alachua County School District only. Levenstein*. excluding Group 19. 



Table A-17 



Attrition on the School Record - Comparison of Pretest Stanf ord-Binet IQ Scores 



Mean IQ Scores 



Significance Levels 



Control 



Program 



Project 


Attrition 
Main Effect 


Interaction 


Final Samp. 
P-C Compar. 


Dropout 


Final 
Sample 


Dropout 


Final 
Sample 


Overal 
Mean 


Seller 




.078 


.477 *# 


87.05 
(20) 


93.70 
(33) 


93.57 
(21) 


91.33 
(36) 


91.69 
(110) 


Deutsch 
(1,2) 


.483 


.235 


.207 


91.57 
(120) 


88.33 
(9) 


91.97 
(239) 


94.49 
(35) 


91.99 
(403) 


Gordon^* 


No Pretest IQ 


— 


— 


— 




— 


— 


— 


Gray 
(1-3) 


A 


A 


. 885 


78.50 
(2) 


88.67 
(15) 


89.88 
(8) 


89.33 
(36) 


88.89 
v61) 


Karnes 
(1-7) 


A 


— 


— 






94.71 
(24) 


94.76 
(78) 


94.74 

(102) 


Levenstein* 


A 


A 


.769 


S7«20 
(5) 


(22) 


(75) 


(101) 


(203) 


Miller 
(1-5) 


No Pretest IQ 
















Palmer 


.083 


.079 


<.001 


86.50 
(18) 


84.84 
(45) 


89.86 
(29) 


95.87 
(91) 


91.28 
(183) 


Weikart 


No Dropouts 




.373 




78.54 
(65) 




• 

79^.57 
(58) 


79.03 
(123) 



ERIC 
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* "A" implies the F for this test was less than 1. 
" Control group has higher pretest IQ score. 

* PPVT pretest IQ. Analyses exclude Group 19* 

** When Stanford Binet score at 3 years old (posttest IQ) is used, the F's for attrition main effect and interactions 
are both less than 1. Gordon: Alachua ^^ounty School District only. ^ ' t 



Table A- IS 

Attrition on the WISC-R - Comparison of Mother Education 



Mean Grades Completed 





Significance Levels 




Control 


Prog 


ram 




Project 
(Groups) 


Attrition 
Main Effect 


Interaction 


Final Sajnp. 
P-C Compar. 


Dropout 


Final 
Sample 


Dropout 


Final 
Sample 


OveraJ 
Mean 


Seller 
(1,2) 

Deutsch 
(1,2) 


No Wise data 
.842 


has been received 
.448 


.706** 


— 

10.00 
(69) 


— 

10.25 
(16) 


10.37 
(46) 


10.02 
(49) 


10.12 
(180) 


Gordon 


.237 


No data for 

Control 

Dropouts 


.713 


— 


9.73 
(11) 


10.35 
(85) 


9.97 
(58) 


10.16 
(154) 


Gray 
(1-3) 


A ^ 


A 


.814 


10.00 
(3) 


8.94 
(18) 


8.75 
(8) 


8.97 

(32) 


8.98 
(61) 


Karnes 
(1-7) 


.390 










10.36 
(22) 


10.07 

(75) 


10.13 
(97) 


Levensceln 


A 


A 


.573 


10.55 
(53) 


10.12 
(25) 


10.62 
(120) 


10.40 
(50) 


10.51 
(248) 


Miller 
(1-5) 


A 


A 


.171 


10.67 
(15) 


•!0.29 
(17) 


10.89 
(95) 


10.87 
(100) 


10.82 
(227) 


Palmer 


A 


A 




11.33 
(39) 


11.29 
(28) 


11.25 
(129) 


11.17 
(103) 


11.23 
(299) 


Veikart 


.161 


A 


.777 


10.11 
(9) 


9.27 

(56) 


10.50 
(A) 


9.39 
(54) 


9,42 
(123) 
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^ '^A" implies the F for this test was less than 1. 
Control group has higher level of toother *s education i 
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Table A-19 

Attrition on the WISC-R - Comparison of Holllngshead ISP Scores* 



Mean ISP Scores 





Significance Levels 




Control 


Prog 


ram 




Project 
(Groups) 


Attrition 
Main Effect 


Interaction 


Final Samp. 
P-C Coapar. 


DroQOut 


Final 
Sanole 


Dropout 


Final 
Sample 


Overall 
Mean 


Beller 
(1.2) 


No UISC data 


has been received 


— 






— 


— 


— 


Deutsch 
(1*2) 


.735 


.888 


.928 


65.94 

(69) 


65.75 
(8) 


66.24 
(45) 


65.57 
(40) 


65.93 
(162) 


Gordon 












63.49 
(79) 


64.72 
(32) 


63.84 
(111) 


Gray 
(1-3) 


A 


A 


.989 


70.33 

(3) 


70.11 
(18) 


66.86 
(7) 


70.21 
(29) 


69.77 
(57) 


Karnes 
(1-7) 


.758 










65.77 
(22) 


65.14 
(71) 


65.30 
(93) 


Levenstein 


A 


• 032 


.011 


64.36 
(53) 


67.80 
(25) 


65.21 

(119) 


53* !>u 
(50) 


(247) 


Miller 
(1-5) 


.514 


No Data on 
Controls 








62.76 
(76) 


63.66 
(96) 


63.26 
(172) 


Palmer 


.154 


A 


.440*' 


57.03 
(39) 


57.43 
(28) 


57. 30 
(128) 


59.92 
(100) 


d8,17 
(295) 


Weikart 


A 


A 


.312 


67.11 
(9) 


69.42 

(55) 


67,50 
(4) 


67.83 
(54) 


68.48 
(122) 


* The Holllngshead Index of Social Position 


(ISP) ranges 


fron 11 to 77, 


with "11" 


representing the highest 


social 
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class and "77'* representing the lowest social class* 
' "A" ii^lies the F for this test was less than 1. 

^(^ Control group has lower ISP, i.e. higher SES level 
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Table A-20 

, Attrition on the WISC-R - Coaparlson of Pretest* Stanford Binet IQ Scores 



Mean IQ Scores 



Significance Levels 



Control 



Program 



Project 
(Groups) 



Attrition 
Main Effect 



Interaction 



Pinal Samp. 
P-C CoTnpar* 



Final 
Dropout Sample 



Pinal Overall 
Dropout Sample Mean 



Beller 
(1,2) 

Deutsch 
(1,2) 

Gordon 



No WISC-R data received 



• 796 



No Pretest IQ 



,873 



.903 



Gray 
(1-3) 

Karnes 
(1-7) 

LevensJiein* 



Miller 
(1-5) 

Palmer 



Weikart 



.761 



.217 



,036 



No Data on 

Follow-up 

Controls 



No Pretest IQ 
A 

.174 



,001 



.220 



' "A" implies the F for this test was less than 1. 
* FPVT pretest IQ. 



91.24 
(112) 



92.06 
(17) 



92.26 
(227) 



92,47 
(47) 



91.99 
(403) 



87.33 
(3) 



87.50 
(14) 



91.40 
(10) 



88.85 

(34) 



88. S9 



(61 



O 



93.48 
(23) 



95.11 
(79) 



94.74 
(102) 



83.83 
(36) 



82 . 74 
(117) 



86.32 
(50) 



83.82 
(203) 



85.22 

(36) 



85.44 
(27) 



93.40 

(70) 



95.84 
(50) 



91.28 
(183) 



81.89 
(9) 



78.00 
(56) 



80.00 
(4) 



79.54 
(54) 



79.03 

(123) 
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APPENDIX B 

Status Report by Instruc^nt 
The data collected from six Instruments comprise the follow-up 
data base* Table 5-1 shows the number of cases received from each 
project site by Instrument as of the September 30, 1978 deadline. 
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Project Site 



Seller 

Deutsch 

Gordon 

Gray 

Karnes 

Levenstein 

Miller 

Fainter 

Weikart 

Vooliaan 

Zigler 

Totals 



Table B-1 

Number of Cases Received bv September 30. 1978 for E ach Instrument by Project 



Parent 
Interviews 



Youth 
Interviews 



School 
Record Form 



Ach't. Tests 



Long School 
Record Form 



108 

81 
107 

72 
165 

98 
141 
143 
106 

54 

1075 



109 
107 
106 
69 
156 
75 
141 
144 
104 
97 
185 

i 

1293 



107 

73 
109 

74 
153 

75 
141 
144 
104 

97 
185 

1851 



102 
63 
103 
72 
143 
115 
134 
197 
96 
349 
185 

1559 



102 



74 
105 



200 



481 



* 

Scores 


Any Data 




121 


107 


119 


90 


115 


72 


77 


112 


168 


76 


188 


141 


141 


132 


228 


110 


123 


95 


611 


185 


185 


1120 


2076 



* scores include WISC-R scores for Gordon. Gray. Karnes. Miller. Palmer. Wooltnan; WISC scores for Levenstein. 

Weikart; WAIS scores for Deutsch; and PPVT scores for Zigler. 
** Any data is defined as number of cases for which data on at least one Instrument were reported. 
*** Total includes 185 Zigler cases who did not have Consortium Interview. 
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APPENDIX C 

Response Rates and Final Dispositions 
In order to calculate responSle rates for the follow-up sample, 
an attrition-disposition work sheet was sent to each project site. 
Eight sites (Seller, Gray, Karnes, Levenstein, Miller, Palmer, 
Weikart and Woolman) sent the data to Cornell in time to be Included 
in this report* The final disposition of each ID case number in the 
eight sites was assigned to one of the following categories. 
(C) Completed « Code 1 

(R) Refused to give pennlssion, refused to be interviewed « 
Code 6 

(U) Located but unable to test because: 
Moved « Code 4 

Unable to test, keep appt., etc. ■ Code 5 
Terminated, unable to complete test » Code 7 
(L) Lost, unable to trace on records ■ Code 3 

(A) Attempted to locate and test: (U) + (L) - Codes 3+4+5+7 
(OS) Out of sample 

Wave not scheduled to test at this follow-up * Code 2 
Dropped from sample at previous follow-up - Code C 
No Data, unknown disposition « Code 9 
Response rates are defined as the number of final dispositions in 
a given category divided by the number of cnses in the total sample 
or subsample. The three response rates computed for completion and 
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rttfusal categories are shown below: 

Response Rate^: Disposition divided by total possible cases 



^^1 " C + R + A + OS 



Response Rate.: Disposition divided by attempts (excludes out of 

sauries) 



C 

e.g. - c + R + A 



Response Rate.: Disposition divided by actual cases contacted 

(excludes lost) 

C 

^•8- ' C + R + U 

The Response Rate Cotnputations and Final Dispositions by Instrument 
for the eight project sites are shown in Table 

As shown in Table C-1, out of the 1869 original subjects in the 
eight sites, 841 Parent Interviews were completed, resulting in a 
completion rate (1) of 44.9%. The rate of completion (2) based on 
the number of parents located and attempted to test is 67.0%. The 
completion rate (3) based on the parents actually contacted for this 
follow-up is 83.4%. The refusal rate (6) for the parents actually 
contacted is 3.2%. The refusal rate (5) based on the total number 
of parents attempted to locate is 2.6%. The refusal rate (4) based 
on all possible parents in the original sample is 1.7%. The total 
number of parent interviews attempted divided by the total number 
in the original population (7) yields a result of 67.0%. This 
result may be considered a sampling fraction or a measure of the 
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•ffort to locate the parents which was dependent an. time, money, 
luck, etc. In contrast, the san^le not atten^ted (8) or out of 
saople remainder is 33.0%. As discussed in mure detail in the 
technical supplement on attrition, the final samples are generally 
representative of the original samples in terms of differential 
rates of program and controls found, pretest Stanford-Binet TQ 
scores, liollingshead ISP and mother's education. 

The results are rimilar for the Youth Interview except that the 
refusal rate is lower. The refusal figure of 29 for the Youth 
Interview includes both youths who refused and parents who refused 
to have their child intejrviewed. 

The refusal rates for the Youth Interview are 1.6% based on 
total original sample (4); 2.4% based on number located and attempted 
to test (5); and 2.9% based on subjects actually conmcted (6). The 
completion rates for the Youth Interviews are: 45.6% based on total 
subjects in original sample (1); 69.2% based on located subjects (2); 
and 86.6% based on number of subjects actually contacted for this 
follow-up (3). The percentage attempted to 65.8% (7) and the out 
of sample percentage is 34.2% (8). 

The Wechsler IQ response rates are similar to the Youth Interview 
figures. The School Record and Achievement have a much higher 
cooqjlction and attempted rate primarily because the Woolman site had 
access to all school records and the Weikart site sent data on all 
school recrords as of fourth grade. 
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In summary, the refusal percentages of 2-3% are acceptably 
and the completion percentages appear satisfactory given the 
fin«- nl and time constraints. 
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Table C-1 



Response Rate Computations and Final Dispositions for Eight Sites 



Parent Youth School 

Interview Interview Record Ach't. Test WISC 

Disposition Rate Equation li^^ N% ^% N^S 



(1) Collet ions 


CRj^- 






c 








841 


44.9 


853 


45.6 


1402 


74.9 


1159 


61.9 


738 


39.4 


C 


+ 


R + 


A 




OS 


(2) Completions 








C 








841 


67.0 


853 


69.2 


1402 


82.9 


1159 


77,3 


738 


71.2 


C 


+ 


R + 


A 






(3) Conpletions 


3 






C 








841 


83.4 


853 


86.6 


1 409 


Q? 4 




RR 7 


/ JO 


R7 "4 


c 


+ 


R + 


U 






(4) Refusals 


RRj^- 






C 








32 


1.7 


29 


1.6 


22 




25 




22 


1.2 


c 


+ 


R + 


A 


+ 


OS 


1.2 


1.3 


(5) Refusals 


RR2- 






C 








32 


2.6 


29 


2.4 


22 


1.3 


25 




22 


2.1 


c 




R 4- 


A 






1.7 


(6) Refosals 


RR3- 






C 








32 


3.2 


29 


2.9 


22 




25 




22 


2.6 


c 


+ 


R + 


U 






1.5 


1.9 


(7) Attempts 


AR " 




A 


+ C 


+ 


R 




1255 


67.0 


1232 


65.8 


1691 


90.3 


1499 


80.1 


1036 


55.3 


c 


+ 


R + 


A 


+ 


OS 


(8) Not Attempted 
(out of sanple) 


OS - 






OS 






617 


33.0 


640 


34.2 


181 


9.7 


272 


19.9 


836 


44.7 


c 




R + 


A 


+ 


OS 
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APPENDIX D 

Special Analyses: Institute for Developmental Studies 

(Drs. Cynthia and Martin Deutsch) 

The Deutsch project was established in 1958 in public schools 

in lower Manhattan and East and Central Harlem. It evolved into 

a five year enrichment curriculum which ran from prekindergarten 

through third grade over about a 10 year period. Eight cohorts of 

children began the IDS program. 

From the original volunteers, children were randomly 
assigned to an experimental (group 1) and a "self- 
selected" control group (group 2)... who started school 
in regular public kindergarten. (Deutsch, et al . , in 
Ryan, 1974) 

In 1976, early data on over 1,000 children who participated in the 
IDS program (waves one through four) were sent to Cornell for 
Consortium analysis. These data included background characteristi 
and pretest and posttest IQ scores. Of this number, 504 children 
were in groups 1 and 2. 

In 1976-78, follow-up data were collected on 119 children 
(groups 1-6, waves 1-4, and waves 5-8). The follow-up total 
includes 22 cases (treatment only) in waves 5-8 who were not on 
Consortium computer file previously. The analyses discussed in 
this report were limited to cohorts 1 through 4, group 1 
(experimental) and group 2 (control). These groups and cohorts 
(N - 91 at follow-up, N - 504 at time of program) were randomly 
assigned and thus provide the most powerful evaluation of the 
IDS program. 
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Two analyses are presented in this section; school outcomes 
and Vechsler IQ scores. 

School record information was received for 51 children (10.1% 
of the original 504 children) . Data on special education assignment 
were available for 37 cases. One of the eight control children 
(12.5%) was assigned to a special education class, whereas none of 
the 29 treatment children was so assigned (Fisher exact p « .4324. 
two- tailed) . 

For grade retention, data were available for 37 children. For 
the treatment group, 23.3% (7 out of 30 children) vere retained in 
grade one or more times compared to 42.9% of control children (3 
out of 7 children). This difference results in a chl-square 
(without Yates correction) of 1.10, p - .2949, two-tailed. 

The third dependent variable in the school outcomes analysis 
was underachievement. This was defined as assignment to special 
education classes and/or retained in grade and/or dropped out of 
school. Data were available for 43 of the children from the 
Deutsch project. This composite variable showed a marginally 
significant difference between treatment and control children. For 
the treatment group, 30.3% (10 out of 33 children) were "undet- 
achievers" compared to 60% of the control group (6 out of 10 
children). This difference results in a chi-square of 2,90 and 
p * .0886, two-tailed. This result translates into an 
educationally significant difference in percent reduction terms. 
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When the underachiever percentages are compared, participation 

in the IDS program resulted in a A9.52 reduction in school failures 

("underachievement") 

In sunnary. children who participated in the IDS program were 
more likely to meet the minimal requirements of their schools. As 
more data becomes available, we will be able to do further analyses. 

Follow-up data on intelligence test scores were collected for 
82 children (54 treatment and 28 controls). Most of these — 6U — 
were over 16 years old and received the Wechsler Adult 
Intelligence Scale (WAIS). The other children received the WISC-R. 
Separate analyses were planned for the young and the older 
children. However, because only three control children were given 
the WISC-R test, analyses were not done for the younger children. 

A cautionary note must precede discussion of these results. 
As described in the attrition analyses, the children who were given 
the follow-up WAIS tests were significantly different from the 
original sample on the Stanford-Binet scores at 5 years old. The 
control children who were found had a lower mean IQ score at 5 
than the controls who were not found; and the found treatment 
children had a higher IQ score at 5 years than the treatment 
children not found. An additional problem for the WAIS analysis 
was that sex was confounded with treatment: the treatment 
children were predominantly female. 



^ Percent reduction - (Z control-Si treatment) /X control, 
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The WAIS was adininistered to 26 treatment children and 24 
control children. The mean age was 18 years 6 months. In general, 
the treatment children had higher mean scores than the control 
children but the results were not significant. As with older 
projects, the t-tests revealed no significant differences between 
treatment and control children on full scale, verbal or perforiMnce 
IQ scores (p » .08, .21, .10, two-tailed, respectively). None of 
the subtests showed significant differences. 
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APPENDIX E 

Interview Coding and Analyses of Constr uct Validity 
List of Interview Items and Coding of Dep endent Variables 

This appendix st^pleiDents the "Non-cognitive Outcomes: Attitudes 
aiid Values" section by providing a complete description of the coding 
of each variable. Variables are presented in the saiae order as in 
Table 16, and the same numbers and nomenclature are used. 

Each variable is followed by a verbatim quote of the interview 
item used and by miscellaneous esqjlanatory notes. 

1. Mother's occupational aspirations for the child . "What kind 
of job would you like (child's name) to have later in life?" 

Specific preferences were coded according to the Hollingshead 
Scale. An additional category was provided for responses which 
indicated that the decision was the child's and which listed no 
preference. 

2 . Percent no choice . See #1 . This variable was the 
percentage of responses indicating that the child's vocation was the 

child's own decision. 

3. ( Algebraic) discrepancy scores . Simple difference between 

#1 and n. 

4. Absolute discrepancy scores . Absolute magnitude of the 
difference between #1 and #2. 
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5. Educational expectationa . "How far do you plan to go in 
achool?" Thia item waa coded as an eight-point ordinal scale: 

1 complete grammar school 

2 some vocational high school 

3 aoiam regular high school 

A complete vocational high school 

5 coaq>lete regular high school 

6 some college 

7 complete college 

8 graduate or professional training 

9 missing 

6. Occupational aspirations . "What kind of job do you want to 
have as an adult?" This item was coded according to the seven-point 
Hollingshead Scale (Hollingshead, 1957). 

7. Whether and where eiig>loyed . "Do you do any kind of work for 
which you get paid?" (Within the last year.) 

Coded according to a three-point ordinal scale: 

0 no 

1 yesy at hotne 

2 yes, outside the heme, or yes, both inside and outside the 
home 

8» Amount of paid work , A composite of #7 and "How often do you 
work?'' 

Coded according to a four-point ordinal scale: 

0 not at all 

1 occasional, temporary, summer 

2 part-time 

3 full- time 

9. Spare time; achievement . "What do you do in your spare 
time?" Up to three responses were coded, and multiple responses 
were auapwd. Responses were dichotomized as follows: 

1 achievement-related 

- look for a job, working, babysit 

- hobbies, crafta, sewing, fix things 
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- do homework, study 

- dr«*, writing stories (creative) 

- practice ausical instrutaent, singing 

- sports activities (if participating) 

- go to the library 

- read, write letters 

0 other . , ^ . . . 

- pUy with friends, talk with friends, go places, get high 

- watching sports activities 

- other outdoor play 

- go to social activiti^ 

- visiting friends, boy (girl) friends, relatives 

- talk on phone 

- play indoor games 

- watch TV 

- listen to music 
• sleep, eat 

- spend time by oneself 

- housework, take care of children 

- nothing 

- no spare tin^ 

10; 11. Best things; achievement and worst thing s; achievement 
"What is the best (worst) thing about school?" Up to three responses 
to each question were recorded and suaiaed. Coding of the two 
variables was identical, excep: that the worst things variable was 
assigned a negative weight. Responses were coded dichotomously as 

follows: 

1 achievement- related 

- academic subjects, general academic activity 

- non-scademic subjects, including P.E., library 

- unspecified learning (unless "easy work")^ 

- homework, exams^ 

- internships 

" daily attendance, promptness 

- responsibilities 



^ As originally coded, these categories included responses which were 
inconsistent from the point of view of the present analysis. There- 
fore, the classification of responses in these categories as 
achleveawnt-reUted or other was based on the original responses 
rather than the category £er se. Accordingly, the placement of 
these categories in the above list is approximate. 

2riG 
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0 other 

- easy work . 

- field trips 

- social activities 

- lunch 

- going home, getting out, etc. 

- fighting 

- being out of the house 

- teachers, other staff, how they treated me 

- discipline, other students* behavior or attitudes 

- unspecifi^ activity, changing classes, etc, 

- learning pace 

- overcrowding 

- nothing, everything 

12. Proud; achievement , "Tell something you've done to make 
you feel proud of yourself." 
Coded dichotomously : 

1 achievement- related 

- school-related achievement, going to school 

- job- related achievement, getting a job 

- helping out at ho^ 

- sports achievement 

- did well in suifle kind of competition; medal in Sunday School 

- developed skills, joined group to better self or skill 

- straightened oneself out 

- doing better in everything 
0 other 

- found money - 

- good behavior - 
self-assertion 

- got married 
^ had a baby 

- moved out on own 
^ altruistic acts 

- interpersonal relations 

- going to church 

- nothing, everything 



Am originally coded, theae categories incliided responses which were 
Inconaiatant from the point of view of the present analysis. There- 
fore^ the claaalflcation of responses in these categories as 
achlc^WMnt-relatad or other was based on the original responses 
rather than the category per se . Accordingly, the placement ot 
thes« categories in the above list is approximate* 
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13. Achievement-orientation ratings of reasons for a dmiring most 
adaircd adult . Answer to. "Why?", following "Of all the grown-ups 
you know personally, wbon do you admire most? That is. who would you 
aost like to be like in some way when you are older?" 

Both polychotooous and dichotomous codings were employed. 
The former had nine categories: 

- admires no adult 

- because of richness, indulgence of subject, and other 
personality traits (not subsumed by the categories below) 

- because of life style (e.g., has own apartment) 

- because of occupational success 

- because of education- related attributes 

- because of skills other than education- related 

- because teaches skills 

- because of fame or respect from others 

- because of unspecified achievement 

The dichotomous code was created by collapsing the code above; 
responses were classified as achieven^nt- related if they focused on 
education, knowledge, skills, occupational success, unspecified 
achievesant, or fame. 

14. Self-evaluation of school performance . "How are you doing 
(did you do) in your schoolwork; that is, overall, not just in one 
subject? Is your schoolwork..." Following this, the interviewer 
read five alternatives which defined a five-point ordinal scale: 

1 much better than the others in your classes 

2 a little better than the others 

3 about the same as others 

4 a little worse than others 

5 much worse than others 
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15. Self -evaluation of hov veil one gets along with the people 
with vhoia one lives . "Generally ijpeaking, how do you get along with 
(people whom respondent has specified as those with whom he lives)? 
Would you say you get along..." Following this, the interviewer 
read five alternatives which defined a five-point ordinal scale: 

1 very well 

2 well 

3 about average 

4 not too well 

5 badly 

16 • Participation in organized cocaaunity activities . "Do you 
participate in any school, church, or community activities or belong 
to any groups or clubs like Scouts, sports, or the band?" 

Responses were recorded as yes or no. 

17« Frequency of participation in organized community activities . 
A composite of #16 and a subsequent question; "How often do they meet?" 
Responses were coded into a six-point ordinal scale: 

1 every day (5 or more days) 

2 twice a week 

3 once a week 

A twice a month 

5 once a month 

6 less than once a month 

These values were transforiMd into a scale of times per month; 
category 1 was assigned a value of 20, and category 6 a value of 0.5. 
A value of zero was assigned if #16 was "no". 

18. Whether one has "special friends" with whom one spends time * 
"Do you have any special friends that you spend time with?" 

Responses were recorded as yes or no. 
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19. Frecmency v^ith which one gets together with "special friends . 
A composite of #18 and the subseqxient question, **How often are you 
with them?" 

Initial coding and subsequent tranfonaation of this Item were 
identical to #17. 

20; 21. Best things; sociability and worst things; sociability . 
Am #10 and #11, except that the dichotonous coding was; 

1 soc iab ili ty- relat ed 

- being with friends 

- interpersonal relationships 

- recess, free periods 

- lifter school activities 

- going home 

- meeting new people 
« lunch 

general (unspecified) 

- being out of the house 

- playing ganes 

0 other 

«. academic and non--academic subjects 

- fighting 

- unspecified learning 

- teachers, other staff, the way they treated xoe 

- homework 

^ field trips 

- internships 

- discipline 

- daily attendance 

- school activity, changing classes 

- pace of learning 

- overcrowding of facilities 

- responsibilities 

- nothing, everything 

- finishing, etc. 

22. Spare time; sociability . As #9, but the dichotomous code 

was: 

1 soc lab ility- relat ed 

- play with friends (unspecified), etc. 

- go to social activities 
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« visit friends, boy (girl) friend, relatives 

- telk, talk on phone 

- play indoor gaiaes 
0 other 

- sporta activities 

- watching sports activities 

- other outdoor play (e.g., ride bike) 

- go to library 

- look for a job, work, babysit 

- watch TV 

- read, writing letters 

- hobbies, etc. 

- do hoaiework, study 

- draw, write (creative) stories 

- listen to music 

- eat 

- sleep 

- practice musical instruxoent, sing 

- spend time by oneself 

- housework, take care' of children, etc. 

- nothing 

no spare time 
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Analyses of Construct Validity 

The dependent variables analyzed in this report vary in their 
face validity. In particular, the coding of several dichotomous 
achievanent orientation variables involved considerable conceptual 
ambiguity. (See section on Non-cognitive Outcomes in text.) 
This appendix, therefore, presents a test of the construct validity 
of two of those dichotomous variables (the achievenent-orientation 
ratings of the respondents' spare-time activities and reasons for 
being proud of themselves), as well as the subjects' self-evaluation 
of their school performance and the discrepancy be"b<een their 
vocational aspirations and their mothers' aspirations for them. 

One approach to testing the validity of variables within a 
domain— e.g., the items which are classified here as reflective of 
achievement orientation— is to assess the degree of intercorrelation 
between them. While such an approach to the issue of validity has 
clear value, in some types of psychometric work, it may be seriously 
misleading when applied to motivational data. McClelland (1975) 
has argued persuasively that if several behaviors are expressions of 
a single motivational construct, it will often not be the case that 
the various behaviors are highly correlated with each other. Rather, 
he maintains that it is often more appropriate to view such 
behaviors as alternative expressions of the motivational state, so 
that they need not occur together. Indeed, they may be negatively 
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correlated, if only because the individual has only a finite 
amount of time to divide between the various alternative expres- 
sions. For example, an intensely competitive individual who is 
high on achievenient motivation, as McClelland (1955) defined it, 
may single-mindedly devote him or herself to academic competition 
in the hope of gaining national professional reknown, while showing 
no interest in (and devoting no time to) other competitive 
endeavors. In the context of our data, a subject may be intensely 
motivated to do well in school and may accordingly use his spare- 
time as a chance to relax ("I go fishing with Grandaddy") rather 
than to join his peers in competitive athletics. 

An alternative approach is to test some form of predictive 
validity. Since the focus of the present definition of achievement 
orientation is those aspects of the construct which "bear on school 
performance," a correlation between school performance or achieve- 
ment and the achievement orientation variables would be evidence of 
construct validity. 

As mentioned above, the Consortium data include three measures 
of actual school achievement: assignment to special education, 
retention in grade, and (in two projects) dropping out of school. 
Analyses indicate that treatment has 

sizable effects on the rate of assignment to special education and 
lesser effects on retention. For the present 
purposes, all three of these variables were pooled to form a single 
dichotomous variable labelled "achiever." Subjects were classified 
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as achievers if they had never been retained or assigned to 
special education and had not dropped out of school, while all 
those who failed to meet one or n»re of these criteria were 
classified as non-achievers. 

In the case of either variables which purport to reflect the 
subject's achievement orientation or variables (e.g., discrepancy 
scores and self-evaluation of schcK)! performance) which would be 
thought to be related to school perforniance for other reasons, a 
strong correlation with this achiever variable would be convincing 
evidence of construct validity. The absence of a strong correla- 
tion, however, would reveal nothing definitive, for such a result 
could reflect two factors other than low validity: 

1. The true correlation between school performance and the 
variable in question could be attenuated by coarseness of 
measurement. The dichotomous "achiever" variable is a very crude 
index of school performance; likewise, a great deal of Information 
is lost in collapsing the wealth of responses to an interview item 
into a dichotomy. While such coarseness of measurement on the part 
of the interview items would indicate low validity (just as a 
variable can not be both unreliable and valid), the coarseness of 
the school performance measure is irrelevant to the question of 
validity. 

2. The size of the true correlation between real school 
performance and the non-cognitive variables considered here is 
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unknown. That is, even if the variables were perfectly valid and 
reliable and were highly refined (ratiier ti.un crude dichotomies), 
the correlations fnight be small, for it might be that most of the 
variance in school performance in these samples is predicted by 
other variables --e.g., income, birth order, mothers' education, 
quality of the schools, and so on. The most appropriate test of 
validity would be the degree to which the observed correlations 
approach these unknown true correlations, not the degree to which 
the former approach 1.00. 

Table E-1 presents the phi coefficients between the achiever 
variable and the respondents' reasons for being proud of themselves. 
Across all projects, the association is significant (p < .02, two- 
tailed), which demonstrates some validity of the item, as coded, as 
an index of achievement-orientation. 

The pattern of age differences revealed by Table D-1 is 
striking: the association among the older projects is positive 
(mean phi « .25) and highly significant (p « .0005, two-tailed), 
while there is essentially no association in the younger projects. 
Indeed, two of the three non-significant (and very small) differences 
in the younger subsample went in the contrary direction (i.e., non- 
achievers scored higher on the interview item), and the interaction 
between age and the achiever variable as predictors of the interview 
itm is significant at the .01 level (two-tailed). 
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Table D-2 presents means and t-tests comparing achievers' and 
non-achievers' seTf-evaluation of their school performance. Across 
all projects.* the self -evaluations of the treatment groups are 

significantly higher (p < .003, two-tailed). 

A skeptic might point to the fact that many of the differences 
in Tables E-1 and E- 2 are non-significant, as well as to the negative 
direction of some of the non-significant differences, and argue that 
despite the two sources of attenuation described above, the construct 
validity of these two variables has not been convincingly demonstrated. 
However, the consistency of the age differences manifested by these 
two variables argues in favor of either of two alternative viewpoints. 
First, it is possible that the construct validity of the two variables 
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increases witK age. Second, these data might indicate developmental 
changes in the relationship between school performance and certain' 
related attitudes in these samples. It should be noted in this 
regard that the Weikart project, which among the older projects 
showed the weakest relationships in both cases, also has the young- 
est subjects. At follow-up, Weikart's subjects ranged from 15 to 19 
years old, while Seller's were 18 and Gray's, 19. These two possible 
interpretations are, of course, not mutually exclusive. 

The interview item which posed the greatest ambiguity in coding 
was the achievement-orientation rating of spare-time activities. 
Table E- 3 presents the differences between achiever and non-achiever 
on this item, as it was first coded, i.e., with participation in 
competitive athletics coded as achievement-related. It will be 
recalled that when the item was coded this way, contrt)! subjects were 
rated significantly more achievement-oriented. Table E-3 indicates 
that there is a trend of marginal significance fp « .097, two- tailed) 
favoring the achievers in the younger samples. In th^lder samples 
ahd overall, however, there was no significant difference. (Recall 
in this regard that the treatment-control difference on this item was 
due to the males in the younger projects.) Hence the data offer no 
firm evidence of construct validity. 
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It was noted earlier that the apparent negative 
treatment effeqt on this spare-time Item, as originally coded, 
appeared to be due in large measure to the fact that cwnpetitive 
athletics were classified as achievement-related; when the responses 
were recoded so that athletics were omitted from the achievement- 
related category, no significant treatment-control difference 
remained. Accordingly, it was decided to test the construct validity 
of this second receding as well. Table D-4 presents the results. It 
can be seen that when athletics were not classified as achievement- 
related, "achievers" were rated slightly more achievement-oriented 
when all projects were pooled (p * .043, two-tailed). This pattern 
is marginally significant in the younger projects (p « .054) but not 
in the older. Hence there is some slight evidence of the construct 
validity of this variable when the second recoding— omitting athletics 
from the achievement-related category— is employed. 

However, it would be misleading to state simply that the second 
recoding (which yielded no treatment effect) was significantly associa- 
ted with the achiever variable, while the first (which yielded a slight 
negative treatment effect) was not. One can calculate from Tables 
E-3andE-4 that the mean correlation between the first recoding and the 
achiever variable was .051, while that yielded by the second recoding 
was .077. Neither of these figures is large enough to be persuasive, 
and the difference between them is even less so. One can only note 
with some caution that removing competitive athletics from the 
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achievement-related category— and thus eliminating the slight 
negative treatment effect reponed earlier— does, if 
anytning, slightly enhance the none too substantial evidence of 
the variable's construct validity. 

Table E-5 presents the mean discrepancy between mother's 
aspirations for their children and the children's own aspirations 
of both achievers and non-achievers in each project. It is clear 
that there is no significant overall association between the two 
measures, nor 1s there consistency across projects in the direction 

In sum, the construct validity of four dependent variables was 
assessed. Some support was found for the validity of two of the 
measures: the "proud: achievement" variable and the respondents' 
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self -evaluations of their school performance. Two recodings of 
the third variable— the "spare time: achievement" measure-'were 
tested; in neither case was there persuasive evidence of construct 
validity, though the evidence was slightly more positive in the 
C9i'.ie. of the recoding which excluded athletics from the achievement- 
related category. Finally, no evidence was found in support of the 
validity of the discrepancy score measure. These results must be 
Interpreted in the light of several factors— explained above— which 
make the absence of a significant finding inconslusive. 



Table £-1 

Percent of School "Achievers" and "hten-ach levers" Who Gave 





AchJeven«nt-Rel 


ated Reasons for 


Being Proud 


of Themselves 


Project (d) 


Achievers 


Non-Achievers 


Difference 




S (2-tailed) 


Young Projects (ages 9-13) 










Gordon (67) 


81.4% 


87.5% 


- 6.1% 


-.079 


(.52)* 


Levenstein tt 




mm M 




-- 




Miller (125) 


79.2 


83.3 


- 4.1 


-.041 


(.65) 


Palmer (69) t 


78.0 


68.4 


9.6 


.099 


.41 


Mean 


79.5 


79.7 


- 0.2 




(.876) 


Old Projects (ages 15-19) 










Seller (89) 


70.5% 


53.3% 


17.2% 


.176 


.097 


Gray (50) 


90.5 


51.7 


38.8 


.410 


.0037 


Welkart (64) 


85.4 


70.0 


16.4 


.194 


.120 


Mean 


82.5 


58.3 


24.2 




.0005 


All Projects 


S},0% 


69.0% 


12.0% 




.018 



t Alt mie sanpls- 

Data not available. 

I Figures In parentheses are in the negative direction. 
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Table E-2 

Mean of Children's Sel f- Evaluations of Their Overall School 



Performance Relative to Their Peers, 


"Achievers" vs. 


"hion-ach levers" 


1 


■ Much better than others In your classes; 






3 


- About the same as others; 








5 


« Much worse 


than others. 








Froject (n) 


Achievers 


Non-achievers 


01 f f erence 




p (2-taned) 


Young Projects (ages 9-13) 












Gordon (73) 


O DA 

Z.B4 


O HQ 
£.07 


.15* 


-.097 


Uevenstein (75) 


2.55 


2.88 


-.33 


ISO 




Miller \139} 


2.85 


2.81 






( POO) 


Palmer t (139) 


2.62 


2.74 


-.12 


.066 


.441 


r^»iiiii 


2.72 


2.78 


-.06 




.621 


Old Projects (ages 15-19) 












Seller (90) 


2.22 


3.04 


-.82 


.463 


.000005 


Gr«y (SO) 


2.62 


2.83 


-.21 


.197 


.170 


Welkart (69) 


2.57 


2.77 


-.20 


.121 


.320 


Mean 


2.47 


2.88 


-.41 




.00007 


Mil Projects 


2.61 


2.82 


-.21 




.0028 



I All lisle sanple. 

* A positive difference Indicates that the self -evaluations of the control children were higher, 
I Figures in parentheses are In the reverse direction. « **; 
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Table E-3 



Mean Achtevement-orlentation Ratings of Sc>are' 


'time Activities, 


"Achievers" vs. 


"Non-ach fevers" (with competSttve athletics 


coded as 


ach i evement- rel ated) 


• 

Project (s) 


Achievers 


Non-achievers Difference 




p (2-tailed) 


Young Projects (ages 9-13) 












Gordon 


.69 


.58 


.11 


.079 


.524 


levenstein 44 








— — 


" — 


HI Her (139) 


.66 


.42 


.24 


.159 


.063 


Palmer t (139) 


1.05 


1.00 


.05 


032 


706 


nefln 


on 


.67 


.13 




.09/ . 














Seller (89) 


1.00 


.86 


.14 


.087 


.420 


Gray (48) 


.52 


.67 


-.15 


-.111 


(.452)* 


Weikart (96) 


.95 


.87 


.08 


.057 


.582 


Mean 


.82 


.80 


.02 




.729 


All Projects 


.81 


.73 


.08 




,157 



t All Male sanple. 
tt Oata not available. 

I Ffgurts tn parentheses are in the reverse direction. 



Table l-k 



Mmh Achlaveraent-orlentatjon Ratings of Spai 


re-time Activities, " 


Achievers" vs. 


"Non-achievers" 


(Miittfna coiroetltlvc athletics 


from the achievement 


-related category 


Proiect in) 


Achievers 


Non-achievers 


Difference 




_B (2-taned) 


Young Projects (ages 9-13) 












, Gordon (68) 


.50 


.42 


.08 


.058 


.643 


tevenstein 44 






« mm 






nnier (139) 


.37 


.15 


.cc 




.016 


Palner t (139) 


.53 


.47 


.06 


.041 


.631 


man 


.47 


.35 


.12 




.054 


Old Projects (ages 15-19) 












Seller (89) 


.76 


.41 


.35 


.237 


.025 


Gray (48) 


.29 


.37 


-.08 


-.071 


(.630)* 


Weikart (96) 


.31 


.32 


-.01 


-.014 


( .890) 


Mean 


.45 


.37 


.08 




.352 


All Projects 


.46 


.36 


.10 




.043 



% All male sample. 
1$ Data not available. 

# Figures In parentheses are in the reverse d1 recti on t 



Table E-5 

Mean Discrepancy Between Mother's Occupational Aspirations for the Child and 
the Child's Own Aspirations, "Achievers" vs. "Non-achievers" (Based on Holllngshead Codes) 



Project (n) 



Achievers Non-achievers Difference 



Q (2-ta11ed) 



Gordon (47) 


-.16 


-1.13 


.97 


.245 


(.101)^ 


Levenstein (27) 


-.47 


- .63 


.16 


.050 


(.811) 


Miller (in) 


-.67 


- .43 


-.24 


-.048 


.624 


Palmer t (35) 


-.93 


- .13 


-.80 


-.204 


.259 


Mean 


-.56 


- .58 


.02 




(.897) 


Old Projects (ages 15-19) 












Seller (60) 


-.74 


.21 


-.95 


-.269 


.039 


Gray (32) 


-.21 


-.39 


.18 


.044 


(.818) 


Welkart tt 












Mean 


-.48 




-.39 




.197 


All Projects 


-.53 


-.42 


-.11 




.529 



* See Table 17 for Holllngshead code. 
t All Male saMple. 

tt Data not usable. 

# Figures in parentheses are In the reverse direction. 
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APPENDIX F 



DEVKLOPMKHIAI. CCMiriHUm CC»SORiIUM . 

PARENT FOLLOW-OP lllTERVIEM ^Imih) 

CMILO HME. CHILD ID PARENT NAME _ 

COO Kor READ ALTERNATIVE ANSWERS TO QUESTI(»iS UNLESS SPECIFICALLY INSTRUCTED TO DO SO. 
Rl^ORb 9 or 99 FOR NO ANSWER OR NOT APPLICABLE, 8 or 98 FOR DON'T KNOW] 

1. First, I want to ask you Bomm questions «bout your household. Could you list for me 
evarvone who lives here, beginning with yourself and the other adults and going down to the 
youngMt children? [RESPONDENT MAY LIST BY NUMBERS OR INITIALS. RATHER THAN NAMES IF DESIREDl 

a. What relation is (person) to (sai^ile child)? 

b. la that a «an (boy) or woaan (girl)? [ASK ONLY IF NOT OBVIWS BY !;AME] 

c. How old la he/she? [AS OF LAST BIRTHDAY] 

[IF UNDER 2 YEiOlS, RECORD AGE (UNDER 1 YR, RECORD 00) AND SKIP TO NEXT PERSON] 

[IF 2 TO 6 YEARS . RECORD AGE AND ASK d:] 

^ d. Is (person) in school (pre-school, nursery) part tiae or full time? 

X 0 No [RECORD AND SKIP TO NEXT PERSCSi] 

1 Part time or 2 Full tisw [RECORD AMD ASK e:] 

e. What grade is he/she In? [RECORD 50 COB pre-school, 51 FOR 
t Kindergarten. 01 FOR First grade, etc. AND SKIP TO IffiXT PERSON] 



[IF 6 TO U YEARS . RECORD AGE AND ASK d:] 

d. Is (person) in school part time or full time? 
0 No [ASK f:) 

f . What grade did he/she complete? [RECORD GRADE IN YEARS AND SKIP 
TO NEXT PERSON] 



1 Part time or 2 Full tl»s [RECORD AND ASK e: ] 
— e. What grade is he/she in? [RECORD GRADE AND SKlP TO NEXT PERSON] 



[IF OVER 14 YEARS . RECORD AGE AND ASK d:] 

d- Is (person) in school part time or full time? 

0 No (RECORD AND ASK f : ] 

f. What grade did he/she complete? 

-[IF LESS TH AN 1,2 GRADES, RECORD AND SKIP TO h. below] 



^ [IF 12 OP MORE GRADES COMPLETED ASK g:] 

g. What degree or diploma did he/she receive? [SUIP TO h. ] 

1 Part ti»e or 2 Full time [RECORD AND ASK e:] 

c. Whet grade is he/she in? [RECORD AND ASK h: ] 

h. Does (person) have a part time or full time paid job? 

0 No [IF UHSIPLOYRD OR RETIRED. ASK:] 

Has (perse ; ever had a paid job? [IF NO, ASK:] What is he doing now? 
*^ [IF YES, ASK i. BELOW] 

1 Pert time or 2 Full time [RECORD AND ASK 1:] 

i. What does (did) he/«..e do on tli.ir job? [PROBE FOR SPECIFIC HOLLINGSHEAD 
CC*>ABLE JOB TITLE AND DESCRIPTION. 
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- 2 - 


Project 

ID Child ID File Card 


1-8 


Child ID 




ri 










X. Household 

A. Relation to 
S«Bpls child: 

01 Fathftt 

02 Hothttr 

03 GuArd 1 an/St ap- 

04 Gr«odpat«nt 

05 Oaclft/Aunt 

06 Gr. Unc/Atmt 

07 Sibling 

08 Hf/Step Sib 

09 Cousin 

10 No relation 

11 SattpU child 

12 Othar (specify) 

Saac 0 Hala 
1 Famala 

c« Age in years 

d. In School 

0 No 

1 Part-time 

2 Full^tlM 

a« Prasent Grade or 

f . Grade Cottplatad 
(in years) 

g. Degree 

0 No 4 U.S. 

1 Cr.id 5 Other 
prnf (Specify 

2 BA degree) 

3 So»e 
college 

h. Working 

0 No 

1 Parc-tiA« 

2 Full-tiaa 

i. Kind of Job 
(If i#orking) 
or other 
Activity 


Person 1 
Naoe or # 

(ReKpondPiit) 


Person 2 


Person 3 


Person 4 


Person S 


PerAon 6 

1 


1 




1 1 1 


1 


1 ! 














□ 


□ 


□ 


□ 


a 


□ 
21-26 


LU 


1 




1 


1 t , 


L.LJ 

27-38 

i 1 

39-44 


□ 


n 


□ 


n 


n 


i 1 i 












1 






□ 


□ 


LJ 




45-46 

1 1 

57-62 




t "1 

□ 


□ 


□ 


n 


63-68 
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□ 


; USE 








□ 


1 u 




n 




1 169-74 



254 



Child ID 



* Ik 1* I* ik 



Tl l-H 



Person ^ 
Nam or I 



«. X«lmeioii to 
S«»pl« child; 

01 Fmttuir 

02 Mother 

03 Guard ian/Step' 
Far eat 

04 Groodparant 
U3 Uocla/Auot 

06 Cr. Uoc/Auot 

07 Sibliiis 

05 U£/Stap Sib 

09 Couiio 

10 llo relation 

11 Saaple child 

12 Other (specify) 



b. Sex 



0 Male 

1 Feaale 



c. Afte in years 

d« Xa School 

0 Uo 

1 Part-time 

2 FuXl^tiM 

e« Present Gradeor 
f. Grade Completed 
(in years) 



4 H,?. 

5 Other 
(Specify 

degree) 



g. Degree 

0 No 

1 Grsd 
prof 

2 M 

3 Soae 
college 

h. Working 

0 No 

1 Part-ti«e 

2 Full-tiae 

1. Kind of Job 
(if wrking) 
or other 
Activity 



LI 



a 
m 



□ 



LJ 



□ 



Person S 



□ 



I □ 



□ 



□ 



□ 



Person 9 



□ 



□ 



□ 



□ 



FOR OFFICi; USE 



□ 



Person 10 



□ 



LJ 



□ 



□ 



Person 11 



HQ 



□ 



LI 



□ 



a 



Person 12 



9-20 



OH 

27-38 

D 
□=] 

45-46 



57-62 



□ 

63-68 



□ 



□ 



0<!-74 
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Child ID 



1. Housthold 



Fercott 13 
Kaa€ or # 
(Rfispoodeat) 



R«i«tlcm to 
S«Bple child: 

01 Father 

02 Mochftr 

03 CiMrdiasi/Step-* 
P«r<at 
Gtndpmtmtkt 

05 Unclft/Aimt 

06 Cr. Unc/Aunt 

07 Sibling 

08 Hf/Sccp Sib 

09 Cousin 

10 Ho rolfttion 

11 Sample child 

12 Other (specify) 

b. Sex 0 Male 

I Fesele 

c« Age in years 

d . . In School 

0 No 

1 Part-time 

2 Full-tXse 

e« Present Gradeor 

f • Grade Conpleted 
Cln years) 

g. Degree 

0 i^o ^ H.S. 

1 Grad 5 Other 
prof (Specify 

2 EA degree) 

3 Some 
(college) 

h« WoriOng 

0 No 

1 Part-ciae 

2 Full-tioe 



□ID 



□ 



□ 



LJ 



1. Kind of Job 
(if working) 
or other 
Activity 



□ 



Fereoo 14 



□ 

HI 



□ 



C3 



Person 13 



□ 



□ 



□ 



Person lu 



p 



m 



LJ 



□ 



FOR OFFICE USE 



□ 



□ 



Person 17 



PZI 



□ 



□ 



a 



□ 



Person 18 



9-20 



a 



21-26 



27-38 

m 

45-46 
57-62 



□ 

6J 6H 



69- V 4 



256 



Child ID 1*1* ri {'^I'i^ u -s 

2. Qoac (child) have any other <Mr4r brothara or sistara vho are not living at hone? 

0 No ri, 

1 Yaa [IT YBS. ASK b-«l ^ 

h. How Many brothers? 1 J Uo-ll 



c. What are thair agea? | F 'I \~rn nT"! rTli2-iq 
[RECORD BEGINNING IN LEFTKOST BOXl ' ^ ' — ' — ' ' ^ ' — ' — 



d. flow Many jiiaters? 1 . 1 I zQ-kl 

a. Uhat are their agaa? f T 1 1 1 1 n 1 LJJ22-29 



[XJ33- 



34 



3. a ttave thara bcaa any «ale adulta who you woold -aay have had a particularly 
Important affect on ^child) over the vaara? 

0 No 

1 Yaa [IF YES, ASK:] 

t». Who vaa that? [PROBE FOR REUTIONSHIP: IF PERSON NAMED IS | | L .,, 

OUTSIDE THE HCWSEKOLD, FU)BE FOR KALE ADUI.T IN 'HIE UOUSEHOU}] 

00 Natural father 06 Male friend of v^^hcv 

01 Stcp-fathcr 07 Friend of oth . family mesOjer 

02 Grandfather 08 Social aervice agency repreaentative 

03 Uaclm (i.e. social vorker, Big Brother) 
06 Brother (full, half, or 09 Teacher, coach ' 

atep) 10 Clergy 
05 Coualn 11 Otlwr (specify) 

r. [WAS THIS PERSON NAMED AS HOUSEHOLD MEMBER IN QUESTION 1] 

0 No 

1 Yea 

[IF NOT OBVIOUS, ASK:] 

4. Do you live in a house or aparttaent? , — , 

1 House 3 Mobile ho»e | |36 

2 Apartaent 4 Duplex (2 family house with separate entrances) 

[IF NOT OBVIOUS, ASK:] 

5. a. la it in a public housing project? 

0 No 

1 Yes [IF YES, ASK:] 

b. What ia the name of it? 

PROJECT 



□ .7 



6. D^ you own or rent your houae/apartment? 

1 Own I |'8 

2 Rant ' — 

7. Do you share your house /apartaent with any other family? 

0 No , n . 

1 Yea ' — 

8. How many rooms are there, not counting bathroona, in your house (or part of 
the houae you live in)? [IF RESPONSE INCLUDES HALF A ROOM, DISREGARD HALF] 

I { | 4J-41 



ERJC 



320 
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Child ID 

9. About how many houses or spsrtments havs you lived in since (child) was [ "1 | ^2~^3 
five years old? 

10. About how aany scihools has (child) been in since he/she started school ?L_LJ 

7lF RESPONDENT NAJED A KALE ADULT IN QUESTION 1, ASK QUESTION 11, OIHERSrtSE 
SKIP TO QUESTION 12] 

11. During the last year, would you say (isale adult's name) has been employed? 
CKEAD ALTEraiATIVES] 

1 not at all I 46 

2 1/4 of the year (3 nonths) ' — ' 

3 1/2 of the year (6 aontha) 

4 3/4 of the year (9 sonths) 

5 all of the year 

12. During the last year, would you say you have been enjployed? 

C READ ALTERNATIVES] j J 47 

1 Not at all • ' — ' 

2 1/4 of the year (3 months) 

3 1/2 of the year (6 otxiths) 

4 3/4 of the year (9 sonths) 

5 all of the year 



Fine, that takes care of that part, now I W7uld like to ask you soa& questions 
about (child) . Soew of these will be things that you may not have thought about 
before, so take as nuch time as you need to answer. 



13. How far do you hope (child) will go in school? 
f PROBE FOR AMOUNT] 

{IF CHILD HAS DROPPED OUT OR GRADUATE D, ASK : ] 
How far did you hope he/she would go? 



48-49 



01 Coinplete graansar school 

02 80M vocational high school 

03 ecwpl€tt vocational high school 

04 soot regular high school 

05 coaplate regular high school 

06 soM college 

07 complete college 



OS graduate or professional 

school 
09 Other (sj^cify) 



10-19 As far as he/she want to 
go (PROBE FOR AMOUNT: RECORD 

10 if ajsouQt not specified 

11 for f,raB»iar school 

12 some vocational school 

13 complete vocational school, 
etc* ) 



258 



IT 



U.S. 



T 
T 
T 
T 
T 
T 
1 



. — Child ID 

CHILD HAS CROPPED OUT OF SCHOOL, SKIP TO #15] 

CHILD HAS CRADUITED FROM HIGH SCHOOL, SKIP TO #U.b.l 

CHILD IS STILL IS SCHOOL, A^r. f U.a.l 

Mnu rrinaldsrias how thing* are going in your f«»ily, how much schooling do you 
S^li ^SiJlSj^iUbi -bS Jo uSvif [SeSrD 8ESP0KSE AND PROBE FOR AMOUNT. 

THEH SKIP TO #15] j | - j gQ.s^ 



01 co&^Uf grawttr ichool 

02 «»o«e vocational high school 

03 coaplstc vocationsl high school 

04 soiK regular high school 

05 covplcta ragular high sdiool 



06 soae college 

07 ccctplete collega 

08 graduate or professional school 

09 Other (specify) 

10>19 As far as he/she wants to go 
[PROBE FOR AMOWT—RECORD 10 if 
sBOimt not specified, 11 for 
grnnar school, etc.] 



L-> b. Do you think (child) will go any further in school? 



ASK:] . 
Considering how things are going in your faisily, how «uch schooling do you 
think (child) will be able to have? [RECORD AND CONTINUE WITH #.15J 



□ 



52 



06 mom college 

07 complete college 

08 graduate or professional school 

09 Other (specify) 



10-19 As far as he/she wants to go 
{PROBE FOR AMOUHT —RECORD 10 if 
no aaouttt specified, 16 for 
sos^ college, etc;* J 



1-^15. How do you feel about how child has done (did) in school? [RECORD VERBATIM^ 



OFFICE CODF- 1 



55-56 



Overall how satisfied are you with how Cchild)haa done (did) in school? 
Would you say you are . . .[READ ALTEIWATIVES ] 

1 Very satisfied 

2 Soeewhat satisfied ^57 

3 SoMwhat dissatisfied ' — 

4 Very disassatisfisd 



16. What kind of job w«uld you like (child) to have later in life? [PROBE 
FOR SPECIFIC JOB TITLE] 



OFFICE CiiDE 2 
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(Uil Id TO 



17. a. Ilo« (chilU) hc'»fn sick n l«it or Had ncrvouM prubluiw? 

0 No 

1 Y«* {IF YSS, ASK:] 

b. What VMM the trouble? 



39 



OFFICE CODE 3 



60-61 



18. a. Hns (child) ever spent more than a week In the hospital? 

0 No 

1 Yas {IF YES, ASK:] 

b. Why was he/she in the hospital? 



62 



OFFICE CODE 3 
[ZLJ 61-64 



c. How old wsH he/nhe then? 

19. a. Now I want to talk i^out educational experiences sooe children have. 

Did (child) attend Bead Start?' 

0 No 

1 Yes 

{IF YES, ASK:] 

b. For how long? {RE(X>RD IN M(»«THSj 

20. a. Did (child) attend kindergarten? 

0 No 

1 Yes 

{IF YES, ASK:] 

b. For how long? {RECORD IN MONTHS] 



I. J J 



65-66 



□ *7 

I n 68-69 

□ 70 

71-72 



3Z3 
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r.TTia.'i.i..i.ji! 



Child ID 



a. □ 

b. □ 



21. «. Did (child) acttnd Project Follow-Through? 

0 No 

1 Ym 
(IFTIS, A»:) 

b. In what g««d«s? £SEOO!U) IN TOPHOST^BQX AT,b.l 

0 Itlndcrgirtw. 1 lit gr«d«, 1 2^3, rSr^ grade 

22... md (child) pareiciiMte in Kij i«u.u.l «d«c«tioni|l P'^?f™ ^^ff ^JSmplES 
nchool tike iiprach therapy, ap«ci«l .ducation. etc. [INSERT LOCAL EXAMPLES 



0 No 

1 Yea 

[IF YSS, ASKO Prograa 

b. Would you daacrib. It for aa? j j 

[RSCOiD 7IXST FOm PKX^UNS MENTIONED] UJ 

0 Speech chavapy [ ] 

1 Special educacioa ' — ' 

2 Voeatioaal training 

3 Adduced placeaeot r prograac for gifted jrrrj 

4 BemillBT reading, aaCh or other subject 

5 Other (ipacify) 



I of 
yaara 

m 

rj 



10 

11 

12 
13 

14 



OFFICE CODE 4 
Grades 



Q 



15-19 
20-24 



LTJ 

I I 1 30-34 



c* 

d. 



ky years was be/she in che progrea? 



Uov 

What grade was (child) in during the prograa? [EXPLAIN GBADE 
LEVEL(0R LEVELS) Hi WHICH CHILD RECEIVED POXKsAM ]. 



fOFEl ENVELOPE TO DETESMINE IF CHILD IS IN EXPERIMENTAL OR aW^VS!SS'^;*v^T 
ixmiSNTAL, COHTimJE WITH QUESTIOIIS REGARDING INTERVENTICaJ , IF CONTROL SAY:) 

Those are all of the question, that I have for you. Thank you very auch 
for your help. Do you have any ijiaat ions that you would like to ask as about 
this study? 

[DO HOT ASX NEXT QOESTIOMS: CCMPLETE AFtER END OF INTERVIEW] 

23. [IF THE PAREST UVES IN A PUBLIC HOUSING PROJECT, CALL HOUSING AUTHORITY TO 
nETESMDII IF IT IS:] r-, 

1 Low Incoaa ' 

2 Moderate incoaa 

3 Mixed low and aoderate incoaa 

[ETHNIC ORIGIN OF RESPONDENT] 



35 



24. 



0 Caucaaian 

1 Black 

2 Oriental 



3 Puerto Rican 

4 Cuban 

5 Other (specify). 



□ 3S 



ICOHPLETE IMTERVIEWER I1F08MATI0II OH PAOT 13, LAST PAGE] 
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26X 



Child ID 



Dcllvttry Syttea 

1 Centet 

2 Hamm 

3 Coabination 



Now I Mould like to uk tOM specific qucctiont about the progrw your 
child vmm in. Thu* question* arc just to help us evaluate that prograa; it 
doesa't Man that any new prograns like it are being planned by us. 

I'll be a^ng you to think b«ck about the project that 

IsMldiX ^ ^ several years ago, about what it was like, what it did for your 
child, things y<ni liked about it and so on. I know that it has been a long tine, 
but please try to r eiiab er. Take a few minutes to think about where you liv«i 
then, who was in the fa«lly--to help you reMsber back whM (ehlld) was that 
age. 

25' Vhat were sosw of the things you liked about the program? [RECORD V ERBATIM 1 



2S. What did you like best? [RECORD VERBATIM] 



OF FICE CO DE 5 
I I 1 38-39 

J 40-41 



CD"-" 



27. fJhat were 



of the things you did not like about It? [PJECORO VERBATIK] 



28. How would you liave changed it to make it better? [RECORD VERBATIM] 



OFFICE CODE 5 



I I 1 46-47 
0314.-49 

□□50-31 



□□sr 53 

LLlsi 55 



263 



ChUd XD 



•duc«ti«Ml prosrcM for pr«-schooI children «r« i«t up In ccattrs 
or schools. Oth«rs arc set up to have a Hcmm visitor bring cducacional 
activities to {sMilics in chair sm hxmm. 

[FOt OONBXXATXOM UCKE im CSm&-8ASED F&OQtAKS, SKIP TO 30] 

{FOX anm ox hoke-xaseo fxogsaks only, ask:} 

«« Did you lika havio; tha profraa in your bone/in a canter? 

0 Ho ' 

1 Yea 



Vhy or why not? [SKCOMD VERBATIM] 



b. Would you have preferrad to have had it in a cantar/your hosa? 

0 No 

1 Yes 

c. Why or why not? [RECORD VERBATIM SKIP TO 31] 



a. Did you lika iiaving the program in both a center and in your ho«e7 

0 lio 

1 Yea 

b. Why or why not? IRECORD VERBATIM] 



c. Did you prefar either the hoow or canter part of the prograa? 
0 No prafareoce 



1 HOM 

2 Center 



□ 



58 



OFFICE CODE 6 
59-60 
61-62 



m 



63-64 



□ 



65 



OFFICE CODK 6 
66-67 



m 
n 



68-69 
70-71 



□ 



72 



OFFICE CODE 6 
73-74 



QJ 75-76 
m 77-78 



[IF STATE A FXEFESEIKE, ASK:] 
Why vas that? {RECOiU) VERBATIM] 



* I* |6 I 1-8 



OFFICE i ODS 6 
I I lO-lI 

CD 



326 



264 



Child ID 



_prograa a good thing for your 



□ 



26 



31. Ckn«illy »p«*kini, »?»f th« . 

child? 

0 Jio 

1 ¥•« 

8 Doci't know, no antwtr, don't ttmmbmv 

32 PrograiM for young childr«n «r« sat up to provide d*fterent kinds of 

help to fanillM. I h*ve som apecific questions about help you. your 

child, or your fa«ily «ay have received thru this program, it may be 

hard to r»i»«ber no tnke your tiM and think back to when .(child), wns 
that agu. 



17-18 
19-20 
21-22 



Here la a liat of services you say have received thru this FT 1 

prograa. Look at each one and tell «e which of these services or help j ( ) 
you, your child or soweone in your faally received through the prograa.j— ^^^^ 

(HANI) RESPONDtan* CARD WlTll I.J ST OF SERVICES. AN!) ALLOW ADEQUATK TIME TO READ TMl 



LIST 

h'rESKSIDENT has {^IESTIWJS about the service, explain BV giving FURTHER 
E9CAMFUS.1 



XJ 



] 



□ 

fXl 



00 No services received 

01 Hadlcal check-ups or tests? 

02 Medical treatment like shots, nediclne. physical therapy? 

03 Help to find about ADC payments, food stasps, eaploywent service, 
or the naae of a dentist or doctor? 

04 Rides or car fare to the doctor, for field trips to the proRram, 
for social servicea? 

05 Help with personal or Mrital problems, education or job opportunities r 

06 Claases for parents on ho»e ■anageswnt, budgeting, taxes? [ J J 

07 Parties, picnics, field trips for parents? ' 

08 Information about how children grow and learn? 

09 Help in getting along better with your child? b. 

10 Help in learning how to teach your child things yourself? 

11 Free time so that you could go to school, to work, or do shopping 

98 Don't know 

99 Not spplicablc 

b. Now of the services you did receive through the program, which ones 
made a difference or were important to you? 

(RECORD USING SAME CODE AS 32. a.] 

ICOHMEHTSI 



2!j-2C 

27-28 

29-3( 
31-32 

33-3 

35-36 

37-38 



39-AO 

43-44 

45-4 

47-4*5 

49-: 

51-57 

5 J •j4 
55 36 

59-60 



That's all the question* I have for you. Thank you very such for you cooperation. 
Are there any queations you would like to ask roe about the interview? 
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Pilld ID 



33. INTESVIEVES SIGNATURE 



39. 



34. DATE OF INTSRVZEV (Honth, Day) 

35. INTERVIEWER SEX 0 Male, 1 Female 

36. IKTERVIEWER ETHNIC ORIGIN 

0 Caurasian 3 Puerto Rican 

1 Black 4 Cuban 

2 Oriental 5 Other (Specify) 

37. DURATION OF INTERVIEW (in r 

38. PLACE OF INTERVIEW 

0 HooM of respondent 

1 Center site 

2 Telephone 

3 Other (Specify) 



INTERVIEWER ID 



RATE THE DEGREE OF INVOLVEMENT OF RESPONDENT 
1 Highly involved and interested 
2 

3 Neither involved nor unlnvolved 
4 

5 Bored, not interested 



61-62 



mm 



f.3-66 



□ .7 



69-70 



□ 72 



COHMENTS ON PROBLEMS WITH INTERVIEW, SPECIAL CIRCUMSTANCES 



3iS 



266 



(9/20/76) 



DEVELOPMENTAL CONTINUITY 
YOUTH FOLLOW-UP INTERVIEW 



CHILD'S NAME 



PROJECT ID 
CHILD ID 
FILE, CARD 



1-2 
3-6 
7-8 



Introductory Statexaent 

I aa a representative of the ( name of the university or project) . This is 
an independent organization-we are twt part of the public schools or the 
government. 

Our work involves learning oore about young people like yourself. J" this 
interview, we will be asking a number of questions about the things you like to 
do both in and outside school, about your faaily, your friends, and your life 
in general. 

It is iaportant that you feel free to tell me exactly what you think, and 
not Just what you feel I want to hear. Everything you tell me is completely 
confidential. Your name will be reaoved from the IntervJew form, so that no 
one will connect your name with your answers. Don't feel that we can t talk 
tbout the questions. If there are questions that aren't clear to you or that 
you feel are too personal, please tell me. 



Let's talk about school first. Are you still in school? 

0 Ho [IF NO, ASK QUESTION lb] 

1 Yes [IF YES, CONTINUE WITH QUESTIONS Ic AND 2] 

b. Uhat is the last grade you completed and 
got credit' for? [SKIP TO QUESTION 3] 



□ 



c. What grade are you in? 

How far do you plan to go in school? 
FOR AMOUNT] 

01 cotiplete graanar school 

02 8o»a vocational high school 

03 conpl t.e vocational high 
«c^- i 

04 sone regular high school 

05 complete regular high school 



[RECORD RESPONSE, PROBE 



10-11 



12-13 



•4-15 



06 some college 

07 complete college 

08 graduate or professional 
training 

10-19 as far as I can go [PROBE 
FOR AMOUNT; RECORD 10 IF 
AMOUNT NOT SPECIFIED, 11 FOR 
GF^MNER SCHOOL, 12 SOME 
VOCATIONAL, ETC.] 
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3. WImc U (%ni8) the be^t thing «bout school? [PROBE FOR SUBJECTS. 
IHDICATE BEST THING WITH AN *] 



4. What is (wm) the worst thing sbout school? f PROBE FOR SUBJECTS 
USE AH * TO IHDICATE WORST] 



5. 



Ikw are you doing (did you do) in your achoolwork; that is, overall, 
not Juat in one subject? Is your schoolwork. . . [READ ALTERNATIVES] 



1. Much better than the others 
in your clasaea 

2. A little better than the others 

3. About the sane as others 



4. A little worse than others 

5. Much worse than others 



a. 



Do you participate in any school, church or coiaminity m tivltica or 
belong to any groups or clubs like Scouts, sports or the band? 

0 No 

1 Yea [IF YES, ASK: ] 



What is it (are they) called? [IF NOT CLEAR FROM 
THE NAME. PROBE: What kind of club is that?l 



Newspaper 
Social club 
Service club 
(Red Cross) 

Other (Specify) 

YWCA, Boys/Girl B Cluhif 



b. 



01 


Scouts 


06 


02 


Religious group 


07 


03 


Sports 


08 


OA 


Music 




OS 


Art, Photography 


09 






10 



Type 

of 
Club 



How often do they raeet? 

0 Every day (5 or more days) 

1 Twice a week 

2 Once a week 



3 IVice a month 

4 Once a month 

5 Less than once a nonth 



a. Do you have any special friends that you spend time with? 

0 No 

1 Yes [IF YES, ASK:] 

b. How ofte- are you with them? 

1 Ever: «lay(5 or »ore)4 Twice a month 

2 Twice a week 5 Once a month 

3 Onci! a week g Le.g than once a month 

8. What do you do in your spare tiae? 



OFFICE CODE 7 



n 



16-17 
18-19 

20-21 

22-23 
24-25 

26-27 



□ 



28 



□ 



29 



c . ilow 
often 



30-12 



□ 

n 33-35 



□ 
□ 



36 

37 



OFFICE CUT. 8 
38-39 
40-41 
42-43 
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9. 



«. DO you h.v« any books of your own? [OTHER THAN TEKTBOOKSl 



10. 



0 No 

1 Yes 



How n»xxy hours a week do you spend resding books or magazines? 
[RECORD 01 FOR 1 HOUR OR LESS] 

What kinds of boo;« do you read? [RECORD FIRST FOUR TYPES 
MEHTIONED AND SPECIFY NAME OR Sl^JECT OF BOOK] 



□ 



45-46 



01 Cowlc books 

02 Adventure/^stery_ 

03 Western 



04 Love/Rostance 

05 Fantasy 



14 

15 

16 

17 

18 

19 

20 

09 ABMseaent/Hujoor . 21 

10 Castes, Sports, Autonoblles 22 

12 Family Life 23 

13 Self iBprovenent 24 



Recr«ation/Hobbies__^ 
Information (Encyc). 



Biography/Autobiography_ 



47-48 



06 SplritualisWAstrology_ 

07 Science Fiction 

08 Pornography 



Arts and Music 
Nature /Science 
Anifiial Stories 

Other 

Crls» 



49-50 



Religious (Bible) 

Other Nonfiction (History) 
Other Fiction 



Do you read magazines? 

0 No 

1 Yes [IF YES ASK: 3 



□ 



55 



h. What kinds of magazines do you read? [RECORD FIRST FOUR TYPES] 



10 
11 

12 
13 

14 



Comic Books 

Children's Magazines 

(Jack & Jill) 

Huaor Magazines (Mad) 

School Magazines (Weekly 

Reader, Jr. Scholastic) 

Other (Specify) 



15 Playboy_ 



11. a. 



01 News (Tioe /Newsweek) 

02 Love/Romance 

03 Sports 

04 Rock Hamic (Rolling Stone) 

05 Hobbies (Arts and Crafts) 

06 Adventure 

07 Pornography 

08 Fash ion /Teenage advice 
(Seventeen, Clamour) 

09 Feature (Ebony, Family Circle) 16 Religious 

DO you read a newspaper? [THIS INCLUDES ANY PART OF NEWSPAPER] 

0 No 

1 Yes [IF YES, ASK:] 

I How often do you read it? 

1 Every day 

2 A couple of times a week 

3 A couple of times a month 



Q 



56-57 



CD 58-59 

CD 

□71 ^2-" 



□ 
□ 



64 
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a. Do you ute th« school or cowronlty library? 

0 No 

1 Yu I IF YES. ASK: Which one?] 

1 School 

2 CoBKxnity 

3 Soth 

h. Do j'ou have « comunity library card? 

0 Ho 

1 Yaa [IF YES, ASK:] 

a aonth do you usa it? 

4 Four tioes 

5 More than four tlaea 

6 Six to 11 tiaea per year 

7 One to 5 tiaes per year 

0 No 

1 Yea [IF YES. ASK: J 

b. Hov mich television would you say you watch? 

Do you watch: [READ FIRST PHRASE OF ALTERNATIVES] 

1 More than three hours a day (21 + hours a week) 

2 2-3 hours a day (14-20 hrs. a weeks) 

3 1-2 hours a day (7-13 hrs, a week) 

4 Less than an hour a day (less than 7 hrs. a week) 

Do you have any room In your hose where you may go whenever you want 
to be alone? 

0 No 

1 Yes [IF YES, ASK:] 

Which rooaCs) is that? 

1 Own bedr<K>m (or shared bedroom) 

2 Den or living room (playroom) 

3 Dining room 

4 Kitchen 

5 Cellar or attic 

6 Bathroom 

7 Other (Specify) 



a* Do you do any kind of work for which you get paid? 
[AT HOME OR OUTSIDE THE HOME, WITHIN THE LAST YEAR] 

0 No [SKIP TO 16] 

1 Yes^ at home 

2 Yes, outsif<.t the home [IF YES, ASK 15b and 15c] 

3 Yes, both inside and outside the hotx 



c» How sHiny tijMS 

0 Never 

1 Once 

2 Twice 

3 Three tiaas 
a. Do you watch television? 



* Wliat kind of work do you do? [RECORD SPECIFIC 
JOB DESCRIPTION} 
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(coo't) 

c. How often do you vork? 

1 Full-til* 

2 P«rt-tim« 

3 Occ«»ion«l, teaporary, :*uaB«r 



□ 76 



1-8 



• • • 



Wh«t kind of job do you want to have 
{IF CHILD IS IN 8th GRADE OR LESS ] when you grow up? 

UF CHILD IS IN 9th GRADE OR HIGHER] m «n adult? 



OFFICE CODE 10 



Vhat i« the worst trouble you've ever been in? [RECORD 
VERSATIH: PROBE: Anything else?] 



Tell M •©■ething you*ve done that made you feel proud of 
yourself. (RECORD VERBATIM] 



OFFICE CODE 11 

m 

OFFICE CODE 12 
I I I 12-13 



OK. now let's talk a little about your faaily. 



Different families have different types of living arrangeaents . 
^S^ ^ ^PU Uve with one parent others live wUh^two^ 
parMite. or with grandparents or relative. |IF MORE THAN ONE codk, 
RSCORO 1* end SPECIFY] 



00 
01 
02 
03 



Ubo do you live with now? 

Both parents 
Mother only 
Father only 

Part of tias with aother 
«id pert with father 

04 Mother and step-father 
or substitute 

05 father and step-wther 
or substitute 

0^ Grandflother 
07 Grandfather 



OS 
09 

1^ 
11 
12 
13 

14 



Grandparents 
Other relatives 
Siblings 
Foster faidly 
Friends 
Institution (reform 
school, orphanage) 
Other (Specify) (include 
guardian if he/she is not 
one of other codes) 



14-15 



15 Living alone (or with own 
children) 

16 Living with husband/wife 



333 



271 



Child 10 



20. 



21, 



Have you ev«r llv«d soaawhcire oth«r than with your parent* 
(OR PERSON NAMED IN #19) for aore than 3 aontha at ona tiae? 

0 No 

1 Y«» {IF YES, ASK:] 

b. Wm did you live with? [RECORD CODE AS IN #19] 
OTHER (Specify) 

a. Do you cat aupper alone or with other people, aoat of the 
tiae? 



□ 



16 



17-18 



1. Alone 

2. With others [IF WITH OTHERS, ASK:] 

b. Who do you eat with? 

1 Parent(s) 5 Pareat(8), slbllag(a) 

2 SiblingCa) «nd friend (s) 

3 Friend (•) & other (specify) 

4 Parent(s) and Biblins(s) 

c. Do people generally talk during the neai? 

0 No 

1 Yes 

[ASK QUFSTIONS 22-26 FOR WHOEVER THE CHILD HAS SATD HE LIVES 
WITH IN QUESTION #19] 

[IF PARENT IS PRESENT, ASK THEM TO LEAVE FOR QUESTION 22] 

22. Generally »peakin«, how do you get along with (persons named 
in Quest ion 19)? Would you say you get along 



1 Very well 

2 Well 

3 About average 



4 Not too well 
3 Badly 



23. Of ail the grown-ups you know personally , whom do you adnire most? 
That is, who would you nest like to be like In sone way when you 
are older? [PROBE; IF NO ANSWER, ASK! Is there anyone you 
would like to be like?] [DETERMINE RELATIONSHIP OF PERSON TO 
SUBJECT, AND DETERMINE WHY THE SUBJECT RESPECTS THE PERSON] 



□ 19 



□ 



□ 



20 



21 



□ 



22 



OFFICE CODE 13 
J23-24 



24. 



Where have you and your faally gone together within the city 
or area within f}« last aonth? 



0 
1 

2 
3 



Shopping e.id other errands 
Entertainment or outings (aovies, ball 

iMie i , parks , picnics, restaurants) 

Church 

Visit friends or relatives 



4 Cultural events or 
olarM (munmims, concerts) 

5 Other (specify) 



□ 27 



6 Didn't go anywhere with family 



33V 
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2S. «. 



26. 



27 



Child ID 

Uh«« hAvc you «nd your faaily gone together out of the 
% o^^«« L the U.t .onth? (RECORD PLACE AND PURPOSE) 



00 
CI 

02 
03 
04 



Another are* within the «t«te 
Another etete in the eaae 
geogrephic aree 
Northeast U.S. 
Southeast U.S. 
Southwest U.S. 



05 Hid-west U.S. 

06 Northwest U.S. 

07 Far west U.S. 

08 Out of country 

09 Not gone anywhere 
out of city or area 



b. 



[PURPOSE OF TRIP, 
do there? 

01 Visit relative and friends 

02 Vacation 

03 Family ei^rgency 

04 Business trip ( Shopping) 

05 Household oove 

06 Other (specify) „ 



IF NOT MENTIONED, ASK] What did you 



How far away £ro« hoae have you been without adults? 
[RECORD THE FARTHEST] 



4 Out of country 

5 Nowhere 



1 Out of the neighborhood 

2 Out of the city 

3 Out of the state 

IrweCK TO SEE IF CHILD IS EXPERIMENTAL OR CONTROL. IF 

T^K L^END INTERVIEW. IF ^^RIMENTAL ASK; ] 
Now to change the subject again, I want you to think back to 

when you were younger and were in the program. 

Take your time. 



28-29 



30-31 



□ 32 



Fine, that is the end of «y questions. I «PP"jiate VO^^ ^^ 
and hslp. Are there any questions you would l^^^!^—!-— 



OFFICE CODE 6 
I I J 33-34 

35-36 



D 



INTERVIEWER SIGNATURE 



INTERVIEWER NUMBER 



OATE OF INTERVIEW (Mo., Day) 
DURATION OF INTERVIEW (in minutes) 



\ I I I i I INTERVIEWER SEX 0 Male, 1 Female 



] I 37-38 

I I 39-43 



INTERVIEWER ETHNIC ORIGIN 
0 Caucasian 3 Puerto Rican | | 44-46 



1 Black 

2 Oriental 



4 Cuban 

5 Other (Specify) 
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SCHOOL AND ACHIEVEMENT TEST RECORD FORM 



Child's iMM 



Project ID [-[-] Child lDfj;3~J~i Fll*.j7] 
1-2 3-b 7 



Co^lef thl» »gction only once for each child . 

1. Uhat is ths child's current status in school? 

—if still in school, rscord in col. 8-9 the grade child is In, i.e. 07, 
13 (for one ysar post-high school), etc. If ungraded, record 52. 

—if graduatsd fr(» hl«h school and not presently in school, record 92 
in eol. 8-9. 

—if dropp«i out, record GO In col. 8-9; record grade dropped out in 
col. 10-11. 

2. Was the child ever in spceisl education of any type? 

^ ^ 5 EHotionally disturbed 

2 Special education (unspecified) 6 Speech/hearing 

3 E«, TMR 0 No information 

4 Learning disabled 

3. Was the child ever retained or skipped a grade? 

1 No 4 Skipped once or nore 

2 Retained once 0 No Infonsation 

3 Retained tvice or aore 



m 10-11 

□ 12 



□ l3 



Co«plet€ the remainder of the fora for each of four years . 

Report acotee for each relevant year for your atudy. For exaaple, studies with 
subjects who are currently high school age should record the latest year available and 
the 10th, 8tb. atxl 4th grade scores. Studies with younger children should record th^ 
four latest years available, such as 7th, 6th, 5th, and 4th (see instructions). 

List the names snd identification information for each school the child attended 
when (s)he took the achievement tests to be recorded. 



4. Grade (ungraded ■ vear e.g., 74) 
5« School code or ni 



Latest 
grade 



Next highest 
grade 



Next 
grade 



Lowest 
grade 



14-21 
22-33 



6. School district name or number 



1 Fublic^ 

2 Parochial 

School location 

1 Urban 

2 Suburban 

7 Small city 



3 Prlvatp 

0 No information 



4 Rural 

0 No information 



□ 



OFFICE USE 



□ □ □ 



o □ □ □ 



34-37 
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CONSORTIUM ACH^ ^ EMENT TEST RECORD FORM 



child ZO 



P 



fil« 



9 



codm 



13-11 



taonth & ye«r 
adAlnistered 



n-i5 



battery 
or 

level 



edition 

19 



test 

lortQ 

0 



grade norm 

r.. 



typ« 

norm 

g 



raw 
score 



MM of 
subtest 

□ 

38 

□ 

52 

□ 

66 



totsl 
te;it 



reeding 
subtest 



reeding 
subtest 



math 

subtest 



percen- 
tile 



25-27 



39-4 



53-55 



67-69 



28-29 



ate- 

nine 

□ 

30 

□ 

44 

□ 

56-57 58 



42-43 



70-7 



72 



grade-1 

8ge=2 
equiv. 

□ 

31 

□ 

45 

□ 

59 



□ 

73 



grade or «ge 
equivalency 
score 



46-48 



ID 



60-6 



74-76 



standard 
score 



35-37 



49-51 



63-65 



77-79 



ID 



1-2 



child ZD 



3-6 



file 
# 



grade 



8-9 



test 
code 



loonth & year 
adninistered 



10-11 



raw 
score 



total 
test 



of 
subtest 



□reading 
subtest 

38 

□reading 
subtest 

52 

CI math 
] subtest 

66 



25-27 



39-41 



53-55 



67-69 



12-15 



percen- 
tile 



battery 
or 

iBvel 



16-17 



edition 
19 



18-19 



test 

form 

□ 

20 



type 
grade nonr morm 

.□ 



28-29 



42-43 



D 



56-57 



m 

70-71 



sta- 

nine 

□ 

30 

□ 

44 

□ 

58 

□ 

72 



□ 

45 

□ 

59 

□ 

73 



equivalency 
score 



grsde«l j grade or age 
age -2 
equiv. 

□ 

31 



21-23 



standard 
score 



24 



32-34 



rxi.D 

46-48 



60-62 



74-76 



LLLl 



35-:i7 



49-51 



63-65 



77-79 



.sUi UUVt^(NMkNIHKINll»(liU^^)Cfc 1979 - 281683 8032 
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